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Abstract 


The  U.S.  Army  Research  Laboratory  and  the  Soldier  and  Biological 
Chemical  Command-Natick  Soldier  Center,  Natick,  Massachusetts, 
developed  a  situational  awareness  (SA)  assessment  center  (AC)  for 
squad  members,  fire  team  leaders,  and  squad  leaders  at  the  McKenna 
military  operations  in  urban  terrain  site.  Fort  Benning,  Georgia.  The 
AC  was  used  to  conduct  a  two-phase  SA  experiment.  In  Phase  I, 
tactics,  techniques,  and  procedures  (TTPs)  for  the  intra-squad  radio 
were  evaluated  with  the  goal  of  selecting  the  most  effective  TTP  for 
the  intra-squad  radio  in  urban  conditions  such  as  those  evaluated. 
Five  Army  Ranger  squads  conducted  three  mini-vignettes  five  times 
using  different  TTPs  and  a  different  script  each  time  (a  total  of  75 
trials).  The  vignettes  were  scripted  (i.e.,  OpFor  activity,  platoon 
leader  communication,  etc.)  and  were  of  short  duration  to  minimize 
the  number  of  uncontrolled  variables.  In  Phase  H,  the  contribution  of 
the  intra-squad  radio  to  the  SA  of  the  individual  squad  members  was 
evaluated.  The  TTP  selected  from  Phase  I  was  incorporated  into 
Phase  n  procedures  for  communications.  Each  squad  conducted  each 
of  six  different  vignettes  twice  (once  with  and  once  without  the  intra¬ 
squad  radios)  and  used  a  different  script  each  time.  The  AC 
methodology  content  validity  index  was  0.99,  had  high  face  validity, 
and  allowed  successful  discrimination  among  a  variety  of  conditions 
(e.g.,  day  and  night,  five  different  TTPs,  radio  and  no  radio,  etc.). 
Critical  informational  requirements  were  identified  by  echelon  for  each 
of  the  vignettes.  The  use  of  the  intra-squad  radios  significantly 
increased  the  SA  of  the  squad. 
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SITUATIONAL  AWARENESS  AND  COMMUNICATION  EXPERIMENT 
FOR  MILITARY  OPERATIONS  IN  URBAN  TERRAIN:  EXPERIMENT  I 


1.  Introduction 


In  today's  media-mad,  computer-crazed,  internet-immanent,  information- 
impacted  society,  people  are  bombarded  with  data.  Because  so  many  facts  and 
figures  are  readily  available,  people  may  pay  insufficient  attention  to  the  items 
that  are  of  critical  importance  or  they  may  be  unable  to  understand  the 
implications  of  the  critical  information.  A  person  who  is  capable  of  attending  to 
the  information  that  is  important  to  his  or  her  work  and  ignoring  the  bits  of 
information  that  are  unimportant  or  irrelevant,  comprehending  the  meaning  of 
the  additive  or  multiplicative  implications  of  the  bits  of  information,  and 
projecting  an  accurate  course  of  action  (COA)  with  the  knowledge  gleaned  is 
"situationally  aware." 

In  dynamic  environments  such  as  those  encountered  by  the  infantryman,  many 
decisions  are  required  across  a  fairly  narrow  space  of  time,  and  performance 
depends  on  a  current,  continuing  analysis  of  the  environment.  Digital 
technologies,  new  ways  of  doing  business,  and  new  organizational  structures  are 
guaranteed  to  impose  new  informational  processing  and  decision-making 
challenges  on  the  ground  warrior.  Because  the  infantryman's  environment  is 
constantly  changing,  a  major  portion  of  his  job  becomes  obtaining  and 
maintaining  good  situational  awareness  (SA).  This  task  is  one  of  the  major  factors 
that  determine  his  success  or  failure.  Blackwell  and  Redden  (2000)  defined 
infantry  SA  as  "the  warrior's  ability  to  quickly  perceive  and  then  discriminate 
between  facets  of  the  tactical  environment,  to  accurately  assess  and  reassess  the 
where,  when,  and  why  of  that  environment,  to  then  know  and  understand  the 
nature  of  the  tactical  situation  and  to  extrapolate  near-term  courses  of  action 
based  on  this  understanding." 

1.1  Background 

This  experiment  was  conducted  under  the  auspices  of  the  military  operations  in 
urban  terrain  (MOUT)  advanced  concept  technology  demonstration  (ACTD) 
program.  It  was  executed  by  the  Human  Research  and  Engineering  Directorate 
of  the  U.S.  Army  Research  Laboratory  (ARL)  field  element  at  Fort  Benning, 
Georgia,  in  conjunction  with  the  MOUT  ACTD  Technology  Program  Office.  The 
U.S.  Department  of  Defense  initiated  the  MOUT  ACTD  program  in  1997.  Its 
charter  is  to  seek  commercial  and  government  off-the-shelf  technologies  that 
satisfy  32  jointly  derived  requirements  specific  to  operations  in  "built  up"  or 
urban  areas.  The  MOUT  ACTD  has  executed  six  Army,  four  Marine  Corps,  and 
two  joint  experiments  (JEl  and  JE2).  For  each  experiment,  a  variety  of 
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operationally  based  factors  was  evaluated  in  order  to  determine  the  military 
utility  of  the  technologies.  One  of  the  factors  evaluated  was  the  influence  of 
specific  technologies  on  the  SA  of  the  war  fighter.  The  desire  to  answer  this 
question  served  as  the  origin  for  this  research.  The  MOUT  ACTD  program's  SA 
efforts  have  received  significant  interest  at  the  highest  levels  of  the  Army  and 
internationally  as  well. 

1.2  The  Problem 

The  aviation  commrmity  has  been  a  leader  in  recognizing  the  importance  of  SA 
to  pilots  and  has  sponsored  numerous  studies  of  pilot  SA.  Other  domains  have 
also  recognized  the  importance  of  SA  and  have  begun  to  address  the  issue.  For 
example,  Gaba,  Howard,  and  Small  (1995)  proposed  that  SA  is  an  equally 
important  characteristic  in  the  intricate,  precarious,  and  dynamic  field  of 
anesthesiology  because  anesthesiology  shares  these  characteristics  with  aviation. 
Air  traffic  control,  large-systems  operations,  and  tactical  and  strategic  systems 
are  other  occupations  in  which  SA  has  been  recognized  to  be  a  critical  factor  in 
successful  performance  (Endsley,  1995).  The  need  to  study  SA  in  a  wide  variety 
of  occupations  is  clear.  In  each  of  the  occupations  discussed,  workers  must  do 
more  than  simply  perceive  the  state  of  their  environment.  They  must  understand 
the  integrated  meaning  of  what  they  perceive  in  light  of  their  goals  and  must 
project  a  COA.  SA  forms  a  basis  for  decision  making. 

Realistic  simulators  have  facilitated  the  study  of  SA  in  the  aviation  field.  The 
simulators  allow  rigid  control  of  almost  all  aspects  of  the  experimental 
environment.  Endsley  (1995)  suggested  that  her  SA  global  assessment  technique 
could  be  used  in  any  domain  in  which  a  reasonable  simulation  of  task 
performance  exists.  However,  simulations  that  allow  assessment  of  SA  are  not 
available  for  all  occupations.  Consequently,  the  ability  to  use  these  valuable  tools 
to  evaluate  SA  in  environments  other  than  aviation  may  not  currently  exist. 
Rudimentary  simulations  of  the  infantryman's  environment  are  available. 
However,  these  simulators  do  not  currently  replicate  all  the  critical 
characteristics  of  the  environment.  An  infantryman's  job  is  to  move,  shoot,  and 
communicate.  He  does  not  operate  in  a  vacuum;  rather,  he  operates  as  part  of  a 
team.  Infantrymen  are  not  static,  and  their  SA  must  be  developed  during 
movement  and  execution  of  their  combat  tasks.  They  also  rely  on  all  their  senses 
when  they  are  immersed  in  their  environment  to  provide  SA  cues.  Even  though 
some  "part-task"  simulators  have  been  developed,  there  are  currently  no 
simulators  available  that  replicate  all  the  important  features  needed  to 
realistically  evaluate  an  infanhyman's  SA. 

Redden  and  Blackwell  (2000)  successfully  evaluated  the  SA  of  infantry  soldiers  in 
free-play  exercises  during  MOUT  ACTD  JEl  and  JE2.  Free-play  exercises  allow 
the  immersion  of  the  infantrymen  in  a  realistic  natural  environment.  Redden  and 
Blackwell  used  the  questionnaire  assessment  of  knowledge  technique  to  query 
soldiers  about  the  state  of  their  environment  during  "freeze"  frames  in  the 
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vignettes.  Their  methodology  was  shown  to  demonstrate  reliability  as  well  as 
content  and  face  validity.  However,  the  free-play  exercises  were  time  consuming, 
which  hampered  the  ability  to  run  multiple  iterations.  They  also  resulted  in 
many  uncontrolled  variables.  These  included  the  tactics,  reaction,  and  motivation 
of  the  opposing  force  (OpFor),  the  length  of  time  required  to  complete  a  vignette, 
the  capabilities  of  the  leadership  at  platoon  and  higher  levels,  and  the  location  of 
enemy  contact.  In  addition  to  the  uncontrolled  variables  associated  with  free- 
play  exercises,  it  was  determined  that  the  tactics,  techniques,  and  procedures 
(TTPs)  used  by  the  soldiers  and  marines  to  employ  the  MOUT  ACTD  intra-squad 
radios  were  not  consistent  among  any  of  the  platoons.  There  were  inconsistencies 
among  the  Army  platoons  because  there  were  no  prescribed  TTPs.  For  example, 
some  platoon  leaders  took  the  microphones  away  from  everyone  in  the  squad 
except  their  squad  leaders,  while  other  platoon  leaders  encouraged  all  squad 
members  to  talk  freely.  Therefore,  the  Army  platoons  used  whatever  TTPs  were 
dictated  to  them  by  their  platoon  leader.  These  varied,  depending  on  the  "best 
guess"  of  the  platoon  leader  as  to  what  he  thought  would  be  most  effective.  The 
marine  platoon  traditionally  has  no  radio  communications  below  the  platoon 
leader  level.  Therefore,  they  were  tmaccustomed  to  the  radio  communications  at 
lower  echelons  and  they  had  to  "guess"  how  to  control  radio  commrmication  in 
JEl.  The  marine  platoon  from  JEl  that  also  participated  in  JE2  learned  from  their 
experiences  in  JEl  and  applied  a  strict  TTP  to  the  use  of  the  intra-squad  radio 
during  JE2.  The  JE2  results  demonstrated  that  their  TTP  application  was  very 
successful. 

1.3  Purpose 

The  purpose  of  this  study  was  three-fold.  First,  it  was  to  develop  and  validate  a 
methodology  that  augmented  the  strengths  (i.e.,  realism,  reliability,  and  validity) 
and  mirdmized  the  weaknesses  (i.e.,  time  required,  uncontrolled  variables)  of  the 
free-play  methodology  developed  by  Redden  and  Blackwell  (2000).  Second,  the 
study  was  to  evaluate  the  contribution  of  the  MOUT  ACTD  technology  to  the  SA 
of  an  infantry  squad  operating  in  a  MOUT  environment.  Third,  it  was  to  provide 
insights  into  the  TTPs  that  should  be  used  when  the  technology  is  operated  in  the 
MOUT  environment  in  similar  situations. 


2.  Method 


The  experiment  was  conducted  in  two  phases.  In  Phase  I,  five  TTPs  for  the  intra¬ 
squad  radio  in  urban  conditions  were  evaluated  with  the  goal  of  selecting  the 
most  effective  TTP.  Five  Army  Ranger  squads  conducted  three  mini-vignettes 
using  a  different  script  (five  scripts  were  written  for  each  vignette)  and  five 
different  TTPs  (for  a  total  of  75  trials).  The  vignettes  were  scripted  (i.e.,  OpFor 
and  civilian  on  the  battlefield  [COB]  activity,  platoon  leader  communication,  etc.) 
and  were  of  short  duration  to  minimize  the  number  of  uncontrolled  variables 
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(i.e.,  OpFor  and  COB  reaction,  platoon  leader  tactics,  etc.)-  In  Phase  II,  the 
contribution  of  the  intra-squad  radio  to  the  SA  of  the  individual  squad  members 
was  evaluated.  The  TTP  selected  from  Phase  I  (TTP  1)  was  incorporated  into 
Phase  II  procedures  for  communications.  Each  squad  conducted  each  of  six 
different  vignettes  twice  (once  with  and  once  without  the  intra-squad  radios)  and 
used  a  different  script  to  control  as  many  variables  as  possible  each  time.  Phase  I 
took  2  weeks  to  complete,  and  Phase  n  took  3  weeks  to  complete. 

2.1  Subjects 

Rangers  were  chosen  as  subjects  for  this  experiment  because  previous 
experiments  indicated  that  a  learning  curve  was  associated  with  intra-squad 
radio  use  (Redden  &  Blackwell,  2000).  Because  Rangers  already  use  intra-squad 
radios,  a  long  training  and  practice  period  was  not  needed  to  train  them  to 
achieve  an  asymptote  regarding  intra-squad  radio  usage. 

The  Phase  I  subjects  were  four  Ranger  squads  from  B  Company  and  one  squad 
from  Headquarters  Company,  3rd  Battalion,  75th  Ranger  Regiment.  The  five 
squads  were  nearly  full  strength  (a  total  of  42  soldiers),  and  the  subjects'  average 
age  was  22  years.  The  Rangers  had  an  average  of  12.7  years  of  education,  with  a 
mean  general- technical  (GT)  score  of  115.  They  averaged  26  months  of  military 
service  and  11  months  in  their  current  positions.  Their  self-evaluation  of 
individual  knowledge,  skills,  and  abilities  was  average  to  above  average.  None 
of  the  Rangers  had  combat  or  related  experience.  Complete  results  of  the 
demographics  are  presented  in  Appendix  A,  Section  3,  Demographics. 

The  Phase  11  subjects  were  nine  Ranger  squads  from  A  and  C  Companies,  3rd 
Battalion,  75th  Ranger  Regiment.  The  squads  were  at  full  strength  (a  total  of  84 
soldiers)  and  the  soldiers'  average  age  was  22  years.  The  Rangers  had  an  average 
of  12.7  years  of  education  with  a  mean  GT  score  of  118.  They  averaged  24  months 
of  military  service  and  11  months  in  their  current  positions.  Their  self-evaluation 
of  individual  knowledge,  skills,  and  abilities  was  slightly  above  average. 
Complete  results  of  the  demographics  are  given  in  Appendix  B,  Section  3. 

2.2  Apparatus 

To  begin  developing  a  metric  that  retains  the  strengths  of  the  free-play  metric 
used  by  Redden  and  Blackwell  (2000)  and  minimizes  the  weaknesses,  the 
literature  about  assessment  centers  (ACs)  was  investigated  to  see  if  an  AC  could 
be  developed  to  measure  a  construct  such  as  SA.  An  AC  consists  of  a 
standardized  evaluation  of  personnel  dimensions  based  on  many  contributions 
during  varying  conditions.  This  would  allow  multiple  assessments  of  the 
construct  in  a  more  short-term  and  controlled  environment  than  a  free-play 
exercise  would,  and  yet  retain  realism. 
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The  1989  Standards  and  Ethical  Considerations  for  Assessment  Center 
Operations  (Development  Dimensions  International,  1989)  provided  an  excellent 
set  of  guidelines  for  the  development  of  an  AC  for  SA.  The  purpose  of  the  SA  AC 
was  to  evaluate  the  strength  of  the  SA  construct  in  the  participants  during 
different  conditions  (i.e.,  with  and  without  technology,  using  the  technology 
with  different  TTPs,  etc.)  as  opposed  to  the  purpose  of  a  true  AC,  which  is 
selection,  early  identification,  and  evaluation  of  personnel  potential.  However, 
the  methodology  for  AC  development  and  validation  was  applicable  in  the 
development  of  the  SA  AC. 

The  first  step  in  the  development  of  the  AC  was  a  job  analysis  to  determine  what 
should  be  evaluated.  The  job  that  was  defined  was  infantryman  at  squad  level. 
Richie  and  Moses  (1988)  stated  that  a  job  analysis  is  important  in  the  design  of  a 
successful  AC.  The  critical  piece  of  the  job  analysis  for  AC  design  was  the  task 
analysis.  This  analysis  drove  the  development  of  the  tasks  that  would  be 
included  in  the  AC.  Van  Cott  and  Paramore  (1988)  defined  a  task  as  a  goal- 
directed  behavior.  Since  the  purpose  was  to  develop  an  AC  for  evaluating  the 
construct  of  SA,  it  was  decided  that  the  tasks  to  be  included  in  the  task  inventory 
would  be  small  units  of  behavior  without  any  associated  standards,  conditions, 
or  equipment.  These  tasks  were  concerned  with  outcomes  of  performance  or,  as 
Sistrunk  and  Smith  (as  cited  in  Gatewood  &  Field,  1994)  observed,  with  what  gets 
done. 

Because  the  assessment  was  planned  for  an  urban  environment,  an  extensive 
literature  review  of  the  Department  of  the  Defense  MOUT  literature  was 
performed.  This  literature  included  training  manuals,  doctrinal  manuals,  soldier 
handbooks,  training  device  development  manuals,  lessons  learned  papers,  and 
reports.  An  initial  task  inventory  was  then  developed  and  provided  to  a  number 
of  military  and  civilians  working  on  the  topic  of  MOUT,  who  had  been  identified 
by  the  author  and  other  Army  persoimel  as  being  subject  matter  experts  (SMEs) 
in  the  MOUT  job. 

The  selection  of  SMEs  was  very  important  to  the  composition  of  the  task 
inventory.  Mullins  and  Kimbrough  (1988)  found  that  different  groups  of  SMEs 
produced  different  job  analysis  outcomes.  They  indicated  that  educational  level 
and  seniority  affected  the  outcome  of  the  job  analysis.  Landy  and  Vasey  (1991) 
found  that  incumbent  experience  had  a  substantial  influence  on  task  ratings  but 
that  educational  level  and  race  had  minimal  effects.  While  Mullins  and 
Kimbrough  (1988)  differ  with  Landy  and  Vasey  (1991)  about  the  effect  of 
educational  level,  it  appeared  to  be  important  to  ensure  that  a  SME  population 
contained  as  much  diversity  as  possible. 

Choosing  SMEs  for  this  task  was  not  as  simple  as  it  might  be  for  other  jobs. 
Sidney  Gael  (1988)  stated  that  a  SME  group  is  usually  composed  of  6  to  10  job 
incumbents,  immediate  supervisors  of  incumbents,  or  specially  trained 
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individuals  such  as  behavioral  scientists.  There  are  no  current  incumbents  or 
supervisors  in  the  MOUT  job,  since  the  job  only  takes  place  during  a  conflict  or 
war.  Therefore,  the  SME  group  had  to  be  chosen  from  those  individuals  who  are 
knowledgeable  of  current  MOUT  TTPs  and  from  personnel  who  have  fought  in  a 
MOUT  environment  in  the  past.  The  SMEs  chosen  by  the  authors  for  the  review 
of  the  task  inventory  came  from  several  categories.  Two  SMEs  were  retired 
infantr5rmen  who  had  actually  participated  in  MOUT  warfare  during  Viet  Nam. 
One  SME  was  a  young  infantry  officer  whose  job  was  the  development  of 
equipment  for  the  MOUT  environment.  One  SME  was  a  training  developer  who 
was  in  charge  of  developing  training  devices  for  the  MOUT  environment. 
Another  SME  was  a  MOUT  simulation  expert.  One  SME  was  a  retired  Army 
noncommissioned  officer  who  was  responsible  for  the  development  of  the 
MOUT  training  and  doctrinal  manuals.  Two  SMEs  were  responsible  for  assessing 
the  threat  to  the  Rangers  in  MOUT  environments.  Thus,  the  SME  panel  consisted 
of  personnel  from  a  wide  range  of  ages,  seniority  levels,  educational  levels,  and 
perspectives. 

The  SME  conference  began  with  a  discussion  of  the  purpose,  that  is,  the  task 
inventory.  Next,  the  SMEs  were  briefed  about  the  type  of  task  statements  that 
were  needed  for  the  inventory.  They  were  then  issued  a  copy  of  the  initial  task 
inventory  and  were  requested  to  review  each  task  statement  on  the  list  and 
determine  whether  the  statements  represented  appropriate  MOUT  job  tasks.  The 
statements  were  then  reviewed  orally  and  the  SMEs  made  suggestions  for 
changes  in  wording  or  deletion  of  the  item  if  it  was  inappropriate. 

It  is  interesting  to  note  that  there  were  very  few  items  upon  which  the  SMEs  did 
not  ultimately  agree.  The  major  issues  raised  were  whether  certain  tasks  could  be 
performed  by  privates  as  well  as  sergeants  (e.g.,  "perform  a  terrain  analysis") 
and  whether  infantry  could  be  expected  to  perform  a  task  without  the  aid  of  the 
engineers  (e.g.,  "blow  a  hole  in  a  wall").  Once  the  tasks  on  the  list  were 
discussed,  the  SMEs  were  requested  to  generate  additional  tasks  that  were  not 
included  on  the  list.  They  were  able  to  generate  several  tasks.  After  this,  the  SME 
conference  ended. 

The  irutial  task  inventory  was  used  to  develop  the  task  analysis  questionnaire. 
The  rating  scales  for  this  questionnaire  were  included  to  identify  the  degree  to 
which  a  task  was  considered  to  possess  a  rated  characteristic  (Gatewood  &  Field, 
1994).  The  rating  characteristics  were  based  on  the  work  of  several  authors. 
Sanchez  and  Fraser  (1992)  asked  101  incumbents  from  25  service  jobs  to  rate  their 
respective  tasks  for  relative  time  spent,  difficulty  of  learning,  criticality,  and 
overall  importance.  They  concluded  that  ratings  of  task  criticality  and  task 
importance  provided  very  redundant  information.  They  noted  that  task  analysis 
questionnaires  should  include  ratings  of  "time  spent,"  "difficulty  of  learning," 
and  either  "importance"  or  "criticality"  because  each  of  the  three  dimensions 
provides  rather  independent  and  valuable  information  about  tasks.  Schmitt  and 
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Cohen  (1989)  used  "time  spent"  and  "difficulty"  for  their  rating  scales  but  did 
not  include  "criticality/importance."  Based  on  the  research  from  these  authors,  it 
was  decided  to  include  ratings  of  "criticality /importance,"  "difficulty,"  and 
"time  spent." 

The  original  task  analysis  questiormaire  was  administered  to  a  small  group  of 
SMEs  as  a  "pilot."  Their  comments  were  incorporated  and  the  revised 
questionnaire  was  reviewed  by  another  group  of  SMEs  before  final 
administration.  The  complete  MOUT  task  inventory  questionnaire  was 
administered  to  SMEs  identified  by  the  author  via  the  criteria  previously 
discussed.  This  SME  population  included  30  personnel  of  diverse  educational 
levels,  ranks,  and  experience  levels.  The  results  of  the  questiormaire  were  used  to 
rank  the  tasks  for  inclusion  in  the  MOUT  AC.  The  ranking  was  achieved  by  the 
following  formula:  Task  Value  =  2  (Criticality)  +  Time  Spent  +  Difficulty.  As 
many  tasks  as  practical  were  included  in  the  AC  so  that  a  cut-off  score  for 
inclusion  was  not  determined  a  priori.  A  SME  panel  was  convened  after  the 
questionnaire  results  were  generated  in  order  to  determine  how  each  task  should 
be  constructed  in  the  AC.  Once  the  tasks  for  inclusion  were  identified,  an 
additional  SME  panel  was  convened  to  generate  vignettes  that  contained  the 
highest  priority  tasks,  determine  the  number  of  freeze  frames  that  were  needed, 
and  determine  where  to  place  the  freeze  frames  in  the  scenario. 

2.3  Vignettes 

The  vehicles  used  to  evaluate  the  Rangers'  SA  during  this  experiment  were 
vignettes  taken  from  a  Ranger  battalion  scenario.  The  results  from  the  MOUT 
task  inventory  questionnaire  were  used  to  ensure  that  the  most  critical,  difficult, 
and  time-consuming  tasks  from  the  scenario  were  the  focus  of  the  vignettes.  All 
units  of  the  Ranger  battalion  were  simulated  in  a  notional  maimer,  except  for  the 
platoon  involved  with  the  evaluation.  The  platoon  leader  and  squad  in  support 
activities  were  scripted,  and  information  from  these  elements  was  passed  via  the 
AN/PRC-126  frequency  modulated  (FM)  radio  to  the  squad  leader.  Depending 
on  the  iteration  being  conducted,  the  squad  leader  used  either  the  individual 
communication  (ICOM)  intra-squad  radio  or  non-radio  means  of  communicating 
with  his  squad  members. 

Six  free-play  vignettes  (A  through  F)  were  written,  which  were  appropriate 
missions  for  a  squad-size  unit.  Each  vignette  required  scripted  activity  by  the 
OpFor  and  the  platoon  leader  "white  cell"  (simulated  command  group)  activity 
to  control  these  variables.  Evaluator-controllers  (ECs)  accompanied  the  attacking 
squad,  the  support  squad,  the  platoon  white  cell,  and  the  OpFor  to  ensure  that 
the  players  operated  within  the  controls  of  the  vignette  and  to  gather  ground 
truth  data.  There  was  no  plan  to  use  the  support  squad  in  the  defense.  After  six 
offensive  iterations,  it  was  determined  that  the  support  squad  provided  no 
additional  realism  to  the  scenario.  Therefore,  the  support  squad  was  not  used  in 
subsequent  iterations.  Vignettes  A  through  C  (day  missions)  were  used  for  Phase 
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I  and  vignettes  A  through  F  (both  day  and  night  missions)  were  used  for  Phase 
11.  In  order  to  accommodate  the  high  number  of  iterations  required,  multiple 
OpFor  scripts  were  written  for  the  vignettes  (see  Table  1)  so  that  the  squads  did 
not  learn  the  scripts.  Since  the  events  that  would  take  place  in  the  AC  (i.e.,  the 
enemy  actions,  the  placement  of  civilians  in  the  town,  the  radio  communication 
with  the  platoon  leader,  etc.)  could  be  scripted,  the  "ground  truth"  was  defined 
before  the  start  of  the  exercise  by  written  scripts  of  the  vignettes.  Table  2 
provides  a  description  of  each  of  the  vignettes  used. 


Table  1.  Scripts 


Vignette 

Primary 

squad 

Number  of  vignette  scripts 

Support  Platoon 

squad  white  cell 

OpFor 

Phase  I 

A 

5 

5 

5 

5 

B 

5 

NA 

5 

5 

C 

5 

5 

5 

5 

Phase  II 

A 

2 

2* 

2 

2 

B 

2 

2* 

2 

2 

C 

2 

2* 

2 

2 

D 

2 

2* 

2 

2 

E 

2 

2* 

2 

2 

F 

2 

2* 

2 

2 

’•‘Not  used 

Table  2.  Description  of  Vignettes  and  Scripts 

Vignette 

Tactics 

Script  1 

Script  2 

Script  3  Script  4 

Script  5 

Squad  attacked 

Six  OpFor  in 

Six  OpFor  in 

Two  OpFor  in 

Five  OpFor 

Notional 

and  cleared  a 

three  different 

three  different 

one  building 

located  in 

OpFor. 

freestanding 

buildings;  one 

buildings.  One 

with  an  OpFor 

two  different 

Three  COB 

building. 

OpFor  has 

COB  bound. 

duty  roster 

buildings;  one 

in  two 

which  consisted 

an  intelligence 

blindfolded. 

hanging  on 

OpFor  has 

different 

of  four  rooms. 

map.  Two  COB 

and  co-located 

the  door.  Two 

order  of  battle 

buildings; 

Squad  attacked 
across  an  open 
danger  area. 

in  a  fourth 
buildiiig  moving 
toward  OpFor. 

with  OpFor. 

COB  co-located 
with  OpFor; 
one  COB  blind¬ 
folded  and 
assassinated. 

papers.  Two 
COB;  one  COB 
(with  OpFor) 
bound,  blind¬ 
folded,  and 
assassinated; 
one  COB 
located  in  a 
different 
building. 

one  KIA, 
one  WIA. 
One 

building  is 

booby 

trapped. 
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Table  2  (continued) 


"C" 

Day 


Squad  conducted 
a  defensive  pre¬ 
paration  for 
counter  attack. 
Squad  occupied 
the  second  floor 
a  building  and 
observed  OpFor 
activity  on  the 
eastern  half  of 
McKenna 
MOOT  site. 


Seven  OpFor; 
three  in  an 
alleyway,  four 
in  a  building. 
Three  COB; 
two  in  a  build¬ 
ing,  one  in  the 
vicinity  of  the 
cemetery. 


Seven  OpFor;  Seven  OpFor; 
four  in  an  alley-  four  in  two 
way,  three  in  a  different 
building  moving  buildings, 
under  smoke  three  in  the 
cover.  Three  vicinity  of  the 
COB;  two  in  a  graveyard, 
building  waving  Three  COB 
a  white  flag,  in  a  building, 
one  in  the 
vicinity  of  the 
cemetery. 


Seven  OpFor; 
four  in  a 
building  and 
three  in  the 
wood  line. 
Three  COB 
co-located 
with  OpFor. 


Squad  attacked 
and  cleared  a 
building  that 
consist^  of 
three  rooms 
and  a  bell  tower. 
Squad  attacked 
across  an  open 
danger  area. 


Four  OpFor 
in  a  building; 
one  surrenders, 
three  move  to 
another  building. 
Two  COB  co¬ 
located  with 
OpFor;  one 
bound  and 
blindfolded, 
one  moves 
with  OpFor 
to  the  other 
building. 


Three  OpFor 
in  a  building 
(all  WIA);  one 
has  intelligence 
map.  Two 
OpFor  in  the 
wood  line. 
Three  COB  in 
the  wood  line 
with  OpFor. 


Four  OpFor 
in  two  different 
buildings;  one 
OpFor  dead, 
one  OpFor 
uses  a  COB 
as  shield  to 
another  build¬ 
ing.  Two  COB 
co-located 
with  OpFor. 


Three  OpFor 
in  a  building; 
one  KIA,  two 
WIA.  One 
OpFor  in  the 
wood  line. 
Two  COB  co¬ 
located  with 
OpFor;  one 
WIA.  One 
COB  in  a 
different 
building. 


Five  OpFor 
in  three 
different 
buildings; 
two  moving 
under 

smoke  cover, 
one  moves 
to  experi¬ 
mental 
force 
(ExFor) 
building 
and  replaces 
a  satchel 
charge. 

Three  COB 
in  the 
vicinity  of 
the  cemetery 
moving  to 
co-locate 
with  OpFor, 

Four  OpFor 
in  a  build¬ 
ing;  two 
WIA  and 
one  dead. 
Dead  OpFor 
has  inven¬ 
tory  of 
OpFor 
CW 

weapons. 
Four  COB 
co-located 
with  OpFor. 
One  build¬ 
ing  is  booby 
trapped. 


"D" 

Night 


"E" 

Night 


Squad  attacked 
and  cleared  a 
ground  level 
section  of  a 
four-section 
building  that 
consist^  of 
three  rooms. 
Squad  attacked 
across  an  open 
danger  area. 


Squad  attacked 
and  cleared  a 
second  story 
section  of  a 
four-section 
building  con¬ 
sisting  of  four 
rooms.  The 
squad  moved 
through  an 
already  cleared 
section  in  the 
building  and 


Three  OpFor 
in  two 
different 
buildmgs. 
Three  COB 
co-located 
with  OpFor. 
Booby  trapped 
rucksack  in 
hallway  of  a 
building. 


Four  OpFor 
in  two  differ- 
erent  build¬ 
ings:  one  KIA, 
one  surrenders. 
Two  OpFor 
in  the  wood 
line.  Two  COB 
co-located  with 
OpFor;  one 
bound,  blind¬ 
folded  and 
assassinated. 


Two  OpFor 
in  a  building; 
one  surrenders 
(has  intelligence 
map),  one  escapes 
to  the  wood  line 
with  two  COB 
as  shields  (two 
COB  co-located 
with  OpFor). 
Booby  traps 
outside  a 
building. 

Two  OpFor  in 
a  building;  one 
KIA,  one  WIA 
with  intelligence 
map  and  radio. 
Two  OpFor  in  the 
vicinity  of  the 
picnic  area. 

Two  COB  co¬ 
located  with 
OpFor;  one 
dead  and 
booby  trapped. 
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Table  2  (continued) 


"F" 

Night 


attacked  up  one  KIA. 

the  stairwell 
of  the  building. 


Squad  attacked 
and  cleared  a 
ground  level 
section  of  a 
four-section 
building  that 
consist^  of 
four  rooms  and 
a  long  hallway. 
The  squad  moved 
through  the  al¬ 
ready  cleared 
first  and  second 
story  section  of 
the  building  and 
attacked  down 
the  stairwell. 


Five  OpFor  in 
two  different 
buildings;  two 
KIA,  one  takes 
a  COB  hostage. 
Two  COB  co¬ 
located  with 
OpFor;  one 
hostage,  one 
bound  and 
blindfolded. 


Four  OpFor  in 
two  different 
buildings;  one 
KIA,  one 
surrenders. 
Two  COB  co¬ 
located  with 
OpFor;  one 
WIA.  Two 
booby  traps 
in  a  building. 


CW  =  chemical  warfare 
KIA  =  killed  in  action 
WIA  =  wounded  in  action 


2.4  McKenna  MOUT  Site 

The  experiment  was  conducted  at  the  McKenna  MOUT  site  at  Fort  Benrung.  The 
overall  layout  of  McKenna  MOUT  resembles  a  village  with  various  types  of 
buildings,  avenues,  and  other  features  that  one  might  expect  to  find  in  a  small 
European  community.  The  site  itself  consists  of  15  structures  divided  into  29 
buildings  (see  Figure  1).  The  buildings  include  apartment  complexes, 
townhouses,  large  offices,  a  confinement  facility,  a  church,  a  schoolhouse,  a  radio 
station,  small  one-story  dwellings,  and  a  restaurant  with  an  outdoor  patio.  The 
road  network  generally  divides  the  village  into  four  areas,  with  a  perimeter  road 
surrounding  it.  Other  features  within  the  village  and  the  surrounding  area 
include  a  tactical  airstrip,  a  helipad,  phone  booths,  a  children's  playground,  a 
cemetery  with  underground  weapons  cache,  street  lights,  four  water  wells,  two 
helicopter  "hulks,"  and  a  limited  subterranean  system  of  sewer  tunnels  with 
access  into  basement  rooms  of  two  buildings. 

2.5  SA  Question  Sets 

Endsley  (1995)  proposed  that  the  ability  to  objectively  measure  SA  is  critical  for 
progress  and  understanding  in  the  field.  She  critiqued  several  measurement 
tecl^ques  that  have  been  performed  to  objectively  measure  SA.  These  include 
physiological  techniques  such  as  electro-encephalographic  measurements; 
performance  measures  used  to  infer  SA  (e.g.,  time  to  complete  a  scenario,  loss 
exchange  ratio,  etc.);  global  measures  of  overall  operator  performance  that  give 
the  final  result  of  a  long  string  of  cognitive  processes;  subjective  techniques  such 
as  self-rating  and  observer  rating;  and  questionnaires  about  SA  knowledge  that 
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compare  perception  to  reality.  She  suggested  that  the  questionnaire  method 
provides  an  objective  and  direct  assessment  of  SA. 


Figure  1.  McKenna  MOUT  Site  Layout. 


Development  of  the  question  sets  began  by  the  authors  obtaining  as  much 
knowledge  as  possible  about  all  facets  of  the  vignettes  planned.  This  included 
knowledge  of  the  terrain  where  the  event  took  place;  knowledge  of  the 
operations  order  that  was  developed  for  the  vignettes,  including  objectives, 
constraints,  and  the  time  of  day  the  operation  would  take  place;  and  knowledge 
concerning  the  enemy  opposing  force  such  as  the  type  of  weapons  they  might 
carry,  the  number  of  enemy  troops,  and  enemy  location(s). 

A  SME  conference  was  then  held  to  establish  the  critical  information 
requirements  of  the  vignettes.  Each  set  of  SA  queries  (between  10  and  12 
questions)  was  tailored  to  the  specific  type  of  vignette  that  was  used.  A  critical 
information  requirement  for  one  vignette  was  not  necessarily  critical  in  another 
vignette.  Domain  sampling  was  used  to  ensure  that  the  full  spectrum  of  ground 
warrior  focus  (battlefield  operating  systems)  and  each  of  the  levels  of  SA  (i.e.. 
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perception,  comprehension,  and  projection)  identified  by  Endsley  (1995)  were 
covered  in  the  final  question  set.  Several  embedded  events  were  included  to  elicit 
key  situation  assessment  responses.  Development  of  the  specific  SA  questions  to 
be  administered  to  the  participants  as  an  objective  measure  of  SA  was  the  fourth 
step.  While  many  of  these  are  natural  extensions  of  the  critical  SA  elements  that 
were  developed  in  the  third  step,  the  clear  wording  of  the  questions  is  critical  to 
the  assessment  outcome.  Table  3  depicts  the  domain  sampling  used  for  the 
question  set  development  with  Vignette  B,  Script  3.  A  full  question  set,  script, 
and  domain  sampling  matrix  are  presented  in  Section  1  of  Appendices  A  and  B. 

Table  3.  Vignette  B,  Script  3 


Per-  Com-  Mobility  Combat 

cep-  prehen-  Projec-  Maneu-  Intelli-  &  Surviv- Service  Fire  Air 

tion  sion  tion  ver  C2  gence  ability  Support  Support  Defense 


Ql 

D 

V 

Q2 

B 

8 

rr\ 

Q3 

A 

V 

Q4 

A 

V 

Q5 

C 

Q6 

B 

Q7 

C 

V 

Q8 

B 

V 

Q9 

C 

V 

QIO 

B 

Qll 

V 

Q12 

D 

C2  =  command  and  control 
BOS  =  battlefield  operating  system 


3.  Procedures 


3.1  Phase  I:  TTP  Experiment 

TTPs  for  the  intra-squad  radio  were  evaluated  with  the  goal  of  selecting  the  most 
effective  intra-squad  radio  TTP  for  use  in  the  Phase  II  vignettes.  Five  Ranger 
squads  participated  in  vignettes  A  through  C  and  used  five  different  predefined 
TTPs.  Each  time  they  participated  in  a  vignette,  they  used  a  different  script 
according  to  the  trial  matrix  in  Appendix  A,  Section  2.  There  was  a  total  of  75 
trials.  The  vignettes  were  conducted  during  daylight  hours  only.  Table  4 
illustrates  the  five  different  TTPs  evaluated. 
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Upon  arrival,  the  Rangers  participating  in  Phase  I  received  training  about  the 
five  TTPs  to  be  used  and  were  given  an  experimental  overview,  an  orientation  of 
the  McKenna  MOUT  site,  and  a  safety  briefing.  The  training  was  a  combination 
of  lecture  and  practical  exercise  conducted  by  directorate  personnel.  A  2-hour 
practical  exercise  incorporated  the  TTPs  to  be  used  during  Phase  I. 

Table  4.  TTPs  Evaluated 


TTP  Position  Radio  Communications  flow 


1 


2 


3 


4 


5 


Co  Commander  SINCGARS  Communications  from  top  down  only,  no  communi- 

Platoon  Leader  SINCGARS/PRC-126  cation  from  bottom  up  unless  it  was  of  critical 
Squad  Leader  PRC-126/ ICOM  importance.  (This  was  the  baseline  TTP  as  it  was 

Fire  Team  Leader  ICOM  the  most  common  TTP  used  by  the  Rangers.) 

Squad  Members  ICOM 


Co  Commander  SINCGARS  Communications  from  top  down,  with  only  fire  team 

Platoon  Leader  Squad  Leader  leaders  and  higher  able  to  communicate  upward. 

Squad  Leader  SINCGARS/PRC-126 

Fire  Team  Leader  PRC-126/ICOM 

Fire  Team  Leader  ICOM 

Squad  Members  ICOM 


Co  Commander  SINCGARS  Communications  from  top  down,  squad  members' 

Platoon  Leader  Squad  Leader  communication  controlled  by  leaders.  (Communicate 

Squad  Leader  SINCGARS/PRC-126  when  asked.) 

Fire  Team  Leader  PRC-126/ICOM 
Fire  Team  Leader  ICOM 
Squad  Members  ICOM 


Co  Commander  SINCGARS  Horizontal  communications  freely  flowing  from  top 

Platoon  Leader  Squad  Leader  top  down  and  bottom  up 

Squad  Leader  SINCGARS/PRC-126 

Fire  Team  Leader  PRC-126/ICOM 

Fire  Team  Leader  ICOM 

Squad  Members  ICOM 


Co  Commander  SINCGARS  Horizontal  and  vertical  communications  freely  flowing 

Platoon  Leader  Squad  Leader  from  top  down  and  bottom  up,  plus  communications 

Squad  Leader  SINCGARS/PRC-126  between  squad  members  and  Fire  Team  Leader  at 
Fire  Team  Leader  PRC-126/ICOM  the  squad  level. 

Fire  Team  Leader  ICOM 
Squad  Members  ICOM 


SINCGARS  =  single  channel  ground  and  airborne  radio  system 


One  EC  was  assigned  to  each  leader  (squad  leader  and  team  leaders)  in  the 
experimental  force  (ExFor);  three  ECs  were  assigned  to  the  OpFor,  one  was 
assigned  to  the  supporting  squad,  and  another  was  assigned  to  the  platoon 
headquarters  white  cell.  The  ECs  controlled  the  flow  of  the  vignettes  and 
completed  a  questiormaire  at  the  end  of  each  vignette,  which  served  as  a  data 
point  for  "'ground  truth,"  along  with  the  documentation  from  the  McKenna 
instrumentation,  for  the  grading  of  the  squad  members'  questionnaires.  The 
OpFor  completed  a  questionnaire  for  each  trial  to  gather  data  about  the  ExFor's 
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conduct  of  each  vignette.  The  questionnaire  assessment  of  knowledge  technique 
(Redden  &  Blackwell,  2000)  was  used  to  query  soldiers  about  the  state  of  their 
environment  at  the  final  point  of  each  vignette  (see  Appendix  A,  Sectiori  2  for  a 
sample  questionnaire).  In  addition  to  this  objective  SA  questionnaire,  each 
member  of  the  Ranger  squad  was  given  a  subjective  questionnaire  to  obtain  his 
thoughts  about  the  importance  of  the  questions  and  the  TTP  used.  Additionally, 
two  ECs  monitored  the  intra-squad  radio  net  and  the  platoon  FM  net  to 
determine  the  amount  and  value  of  the  radio  traffic  passed  during  the  vignettes. 
The  scripts  for  the  platoon  white  cell  (Appendix  A,  Section  2)  were  used  to 
ensure  that  timely  information  was  passed  to  the  attacking  squad. 

3.2  Phase  II  -  Intra-squad  Radio  Experiment 

Phase  II  investigated  the  effect  of  the  intra-squad  radio  on  the  SA  of  the 
individual  squad  members.  The  TTP  selected  from  Phase  I  (TTP  1)  was 
incorporated  into  Phase  II  procedures  for  communications.  The  individual 
members  of  the  Ranger  squad  participated  in  the  vignettes  under  baseline 
conditions  (no  intra-squad  radio)  and  then  with  the  intra-squad  radio.  These 
vignettes  were  scripted  and  of  short  duration  to  minimize  the  number  of 
uncontrolled  variables  and  to  maximize  the  number  of  iterations  that  could  be 
run.  Each  squad  conducted  each  of  six  different  vignettes  twice  (once  with  and 
once  without  the  intra-squad  radios).  Vignettes  A  through  C  were  run  during 
daylight  hours,  and  vignettes  D  through  F  were  run  during  the  hours  of 
darkness. 

The  Rangers  participating  in  Phase  II  received  training  and  a  1-hour  practical 
exercise  on  the  TTP  to  be  used.  They  also  received  an  orientation  of  the  McKenna 
MOUT  site,  a  safety  briefing,  and  an  overview  of  the  experiment.  Directorate 
personnel  presented  these  on  the  first  day  of  each  week  when  three  new  squads 
arrived.  During  Phase  II,  only  two  of  the  five  scripts  for  vignettes  A  through  C 
were  used,  and  both  scripts  were  used  for  vignettes  D  through  F. 

One  EC  was  assigned  to  each  leader  (squad  leader  and  team  leaders)  in  the 
ExFor;  three  ECs  were  assigned  to  the  OpFor;  one  was  assigned  to  the  supporting 
squad,  and  another  was  assigned  to  the  platoon  headquarters  white  cell.  The  ECs 
controlled  the  flow  of  the  vignettes  and  completed  a  questionnaire  at  the  end  of 
each  vignette,  which  served  as  a  data  point  for  "ground  truth,"  along  with  the 
documentation  from  the  McKenna  instrumentation,  for  the  grading  of  the  squad 
members'  questionnaires.  The  OpFor  completed  a  questionnaire  for  each  trial  to 
gather  data  about  the  ExFor's  conduct  of  each  vignette.  In  addition  to  the 
objective  SA  questionnaire,  each  member  of  the  Ranger  squad  was  given  a 
subjective  questionnaire  to  obtain  his  thoughts  about  the  importance  of  the 
questions  and  the  TTP  used.  The  scripts  for  the  platoon  white  cell  squad  (see 
Appendix  B,  Section  2)  were  used  to  ensure  that  timely  information  was  passed 
to  the  attacking  squads. 
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At  the  end  of  Phase  II,  the  Rangers  were  given  an  end-of-experiment 
questionnaire  to  elicit  their  thoughts  about  the  contribution  that  the  intra-squad 
radio  made  to  their  individual  SA  and  their  suggested  improvements  for  their 
issued  ICOM  (intra-squad)  radio. 


4.  Results 


4.1  Methodology 

A  content  validation  study  of  the  SA  question  sets  was  performed  with  the 
outline  developed  by  Schneider  and  Schmitt  (1986).  Five  judges  were  used  to 
develop  the  content  validity  ratio  for  each  item.  The  content  validity  ratios  of 
each  item  were  then  evaluated  for  statistical  significance  via  tables  presented  by 
Lawshe  (1975).  Any  item  that  was  not  determined  to  have  significant 
correspondence  with  SA  (p  <  .05)  was  dropped  from  the  experiment.  The  content 
validity  of  the  resulting  measure  was  determined  to  be  very  high,  as  the  content 
validity  index  was  0.99.  The  methodology  had  high  face  validity  and  allowed 
successful  discrimination  among  a  variety  of  conditions  (e.g.,  day  and  night,  five 
different  TTPs,  radio  and  no  radio,  etc.).  The  short  time  required  to  conduct  an 
iteration  (approximately  30  minutes)  made  it  possible  to  run  multiple  iterations, 
thereby  increasing  the  sample  size  that  could  be  obtained.  The  Rangers  indicated 
that  the  vignettes  were  very  realistic  and  that  the  training  value  of  the  vignettes 
was  high.  The  OpFor  and  white  cell  scripts  made  it  possible  to  reduce  the 
number  of  imcontrolled  variables  present  in  a  vignette. 

4.2  Phase  I 

4.2.1  Critical  Information  Requirements 

A  panel  of  SMEs  who  studied  the  terrain  and  the  vignettes  developed  the 
questions  in  the  assessment  of  knowledge  questionnaires.  The  questions  were 
developed  to  assess  the  critical  information  requirements  of  soldiers  in  the 
vignette  and  were  based  on  a  consensus  of  the  group  about  critical  knowledge 
during  each  of  the  vignettes.  Upon  completion  of  the  vignette,  the  soldiers  were 
then  asked  to  rate  the  criticality  of  each  of  the  questioirs.  The  original  questions 
were  SME  hypotheses,  but  the  soldiers  participating  in  the  vignettes  were  able  to 
more  accurately  determine  the  criticality  of  each  of  the  questions  to  the 
accomplishment  of  their  objectives.  Appendix  A,  Section  4  lists  all  the  questions 
rated  critical  from  the  Phase  I  assessment  of  knowledge  questionnaires  and  the 
associated  criticality  ratings  by  vignette.  Table  5  summarizes  questions  that  were 
rated  critical  (5  or  higher  on  a  7-point  scale,  with  7  being  extremely  necessary  for 
performance  and  1  being  extremely  unnecessary  for  performance)  and  their 
mean  ratings  across  vignettes. 
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Table  5.  Critical  Information  Requirements 


Critical  information  Mean  rating 


Mission-oriented  protective  posture  (MOPP)  status  6.00 

Squad's  5.56-mm  (ball)  ammunition  status  5.91 

Limitations  of  securing  building  5.90 

Reports  of  OpFor  using  booby  traps  5.86 

Chemical  threat  status  5.85 

Number  of  OpFor  seen  or  reported  5.65 

Location  of  OpFor  that  are  immediate  threat  to  squad  or  squad  objective  5.63 
Cause  of  explosion  in  stairwell  5.63 

When  and  type  of  coimter  attack  expected  5.54 

Disposition  and  status  of  OpFor  5.49 

Disposition  of  platoon  sergeant  5.47 

OpFor  reinforcement  status  5.44 

Threat  from  OpFor  according  to  intelligence  summary  5.43 

Reports  of  OpFor  using  nuclear,  biological,  and  chemical  (NBC)  and  5.41 

location  of  use 

Most  recent  ensuing  mission  5.32 

Most  probable  OpFor  mission  5.29 

Items  of  intelligence  value  fovmd  5.27 

Disposition  of  friendly  units  5.23 

Reports  of  platoon-sized  element  in  or  around  McKenna  5.21 

Disposition  of  company  command  post  (CP),  company  casualty  5.20 

collection  point  (CCP),  platoon  CCP,  prisoner  of  war  (POW)  points 
OpFor  area  proximity  threat  5.17 

Reported  wind  direction  5.18 

Company's  intention  of  controlling  the  doctor  5.13 

Status  of  the  AC-130  5.13 

Type  resistance  1st  platoon  encountered  5.06 

Disposition  of  re-supply  vehicle  5.03 

Reports  of  activity  in  vicinity  of  airstrip  5.00 

Latest  reported  disposition  of  helicopter  improvement  program  (HIP)  5.00 

helicopter  (air  threat) 


4.2.2  Assessment  of  Knowledge  Questionnaires 

Appendix  A,  Section  4  displays  the  correct  responses  to  each  of  the  critical 
questions  on  the  assessment  of  knowledge  questionnaires.  The  results  from 
questions  that  were  not  determined  to  be  critical  were  removed  before  the 
analysis  of  the  results,  along  with  incomplete  data.  The  questions  that  were 
included  in  the  analysis  are  displayed  in  the  shaded  areas.  The  percentage  of 
correct  responses  to  the  critical  questions  during  each  of  the  TTP  conditions  is 
given  in  Table  6. 


Table  6.  Mean  Percentage  of  Correct  Responses  to  Phase  I  Critical  Questions 


TTP 

Mean 

Standard  deviation 

N  • 

1 

48.02 

19.14 

36 

2 

39.90 

17.78 

36 

3 

35.06 

13.95 

36 

4 

39.77 

19.72 

36 

5 

38.13 

16.73 

36 

The  repeated  measures  analysis  of  variance  that  was  run  on  the  TTP  data  to 
determine  the  impact  of  the  radio  usage  TTPs  on  the  soldiers'  SA  showed  a 
significant  effect  [F  (4, 140)  =  3.59,  p  =  .008].  Ensuing  paired  samples  t- tests  were 
then  conducted  to  isolate  the  differences  between  each  of  the  TTPs  and  the 
baseline  TTP  (TTP  1).  A  Holmes'  sequential  Bonferroni  was  used  to  control  for 
family-wise  error  rate.  With  an  alpha  level  of  0.05,  TTP  1  was  statistically 
significantly  better  than  all  the  other  TTPs.  Table  7  shows  the  results  from  the 
ensuing  experiments. 


Table  7.  TTP  Paired  Comparisons 


t 

df 

Significance 

(2-tailed) 

Holmes' 

sequential 

Bonferroni 

required 

V 

Pair  1  TTP  1-TTP  3 

4.54 

39 

.013 

Pair  2  TTP  1-TTP  5 

2.98 

39 

Pair  3  TTP  1-TTP  2 

2.88 

38 

Pair  4  TTP  1-TTP  4 

2.63 

37 

.012 

.050 

4.2.3  Subjective  Questionnaires 

At  the  completion  of  each  vignette  in  Phase  I,  the  Rangers  were  asked  what 
things  they  considered  to  be  the  most  important  to  know.  Table  8  summarizes 
the  results  from  this  question  across  vignettes. 

During  Phase  I,  no  TTP  effects  were  noted  about  what  the  Rangers  believed  to  be 
critical  informational  requirements.  Overwhelmingly,  they  thought  the  most 
important  things  were  location  and  status  of  the  OpFor  and  ExFor,  followed 
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closely  by  ammunition,  casualties,  and  equipment  (ACE)  reporting  and  ensuing 
missions.  The  status  of  chemical  agents,  even  though  lower  on  total  number  of 
responses,  was  also  very  important.  (The  use  of  chemical  agents  was  only  played 
in  5  of  the  15  scripts.)  A  complete  list  of  the  Ranger's  responses  by  vignette  and 
squad  is  given  in  Appendix  A,  Section  5. 


Table  8.  Responses  to  Three  Most  Important  Things  You  Need  to  Know,  Phase  I 


Action 


Number  of  responses 


Location  and  status  of  OpFor 

290 

Location  and  status  of  ExFor 

267 

ACE  report 

199 

Ensuing  mission 

no 

Status  of  COBs 

65 

CCP  location 

57 

Medical  evacuation  (Medevac) 

45 

Primary  intelligence  requirements 

35 

Status  of  nerve  agent 

22 

Location  of  booby  traps 

6 

Status  of  HIP  helicopter 

3 

Location  of  vehicles 

1 

When  asked  to  subjectively  evaluate  their  SA  using  a  1  to  7  scale  (with  1  being 
extremely  unaware  and  7  being  extremely  aware)  during  Phase  I,  the  Rangers 
predominantly  evaluated  themselves  as  aware  to  very  aware  (see  Table  9). 


Table  9.  Mean  Responses  to  Ranger  Self-Evaluation  of  SA,  Phase  I 


Squad 

TTPl 

TTP2 

TTP3 

TTP4 

TTP5 

1 

5.07 

5.03 

5.19 

5.41 

5.34 

2 

5.79 

5.25 

5.73 

5.75 

5.79 

3 

4.76 

5.00 

4.95 

5.11 

5.72 

4 

5.30 

5.39 

5.14 

5.22 

6.56 

5 

5.12 

5.19 

5.44 

5.08 

4.91 

Mean 

5.21 

5.17 

5.29 

5.32 

5.66 
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The  subjective  ratings  contrast  with  the  soldiers'  actual  SA,  as  measured  on  the 
questionnaire  assessment  of  knowledge  (see  Table  6),  which  demonstrated  that 
the  soldiers  were  aware  of  less  than  half  of  the  critical  irxformation  that  they 
needed  to  accomplish  their  objectives.  Reports  from  previous  experiments  (e.g., 
MOUT  ACTD  JE  1  and  2  reports)  have  indicated  that  respondents  are  not  often 
"aware  that  they  are  unaware."  The  Rangers  rated  themselves  slightly  more 
aware  when  using  TTP  5  than  when  using  the  other  TTPs.  This  is  an  indication  of 
the  Rangers'  belief  that  the  more  freedom  they  were  allowed  on  the  radio  net,  the 
more  situationally  aware  they  were.  In  actuality,  their  SA  was  higher  with  two 
other  TTPs  than  with  TTP  5.  They  rated  the  TTP  with  which  they  performed  the 
best  (TTP  1)  as  the  next  to  lowest  TTP.  It  is  clear  that  purely  subjective  ratings  of 
SA  must  be  interpreted  with  caution.  Mean  responses  to  the  self-evaluation  of  SA 
by  vignette  and  script  are  given  in  Appendix  A,  Section  5. 

The  Rangers'  primary  sources  of  information  during  Phase  I  were  the  intra¬ 
squad  radio  and  voice  commands.  These  two  varied  by  TTP  but  were  used  much 
more  than  the  other  sources  of  information  (i.e.,  visual  signals,  hand  and  arm 
signals,  and  AN/PRC-126  radio).  A  complete  list  of  Ranger  responses  to  source 
of  information  is  given  in  Appendix  5,  Section  4. 

The  OpFor  commented  that  the  Rangers  used  a  lot  of  self-discipline  while  they 
conducted  the  75  vignette  iterations  in  Phase  I.  The  OpFor  was  able  to  hear  the 
Rangers  discuss  their  activities  only  nine  times  during  the  75  iterations  (twice 
when  TTP  1  was  used,  4  times  when  TTP  2  was  used,  twice  when  TTP  3  was 
used,  and  once  when  TTP  4  was  used).  When  the  OpFor  was  asked  to  rate  the 
Rangers'  execution  of  each  mission,  they  rated  it  as  "good."  A  complete  list  of  the 
OpFor  comments  is  given  in  Appendix  A,  Section  6. 

4.3  Phase  II 

4.3.1  Critical  Information  Requirements 

Upon  completion  of  each  vignette,  the  soldiers  were  asked  to  rate  the  criticality 
of  each  of  the  questions.  The  original  questions  were  SME  hjqjotheses,  but  the 
soldiers  participating  in  the  vignettes  were  able  to  more  accurately  determine  the 
criticality  of  each  of  the  questions  to  the  accomplishment  of  their  objectives. 
Appendix  B,  Section  4  lists  all  the  questions  rated  critical  from  the  Phase  II 
assessment  of  knowledge  questiormaires  and  the  associated  criticality  ratings  by 
vignette.  Table  10  summarizes  the  questions  that  were  rated  critical  (5  or  higher 
on  a  7-point  scale,  with  7  being  extremely  necessary  for  performance  and  1  being 
extremely  imnecessary  for  performance)  and  their  mean  ratings  across  vignettes. 

Table  11  displays  the  percentage  of  questions  in  each  BOS  category,  along  with 
the  percentage  of  questions  that  the  soldiers  rated  as  critical  information  to  the 
completion  of  their  mission. 


19 


Table  10.  Critical  Information  Requirements,  Phase  n 


Critical  information 


Mean  rating 


Squad's  5.56-mm  (ball)  ammunition  status  5.69 

Threat  from  OpFor  according  to  intelligence  summary  5.68 

Source  of  hostile  fire  5.58 

Number  of  OpFor  seen  or  reported  5.38 

Location  of  OpFor  that  are  immediate  threat  to  squad  or  squad  objective  5.37 
When  and  type  of  counter  attack  expected  5.30 

OpFor  reinforcement  status  5.20 

Reports  of  OpFor  using  booby  traps  5.18 

Disposition  and  status  of  OpFor  5.11 

Disposition  of  company  CP,  CCP,  platoon  CCP,  POW  points  5.07 

Obstacles  found  on  objective  5.06 

Chemical  threat  status  5.04 

Building(s)  reported  to  be  heavily  fortified  5.04 

Platoon  commander  5.00 


Table  11.  Percentage  of  Critical  Questions  in  Each  BOS  Category 


Category 

Number  of 
questions 
in  category 

Number  of 
critical  questions 
in  category 

Percent 
critical  in 
each  category 

Maneuver 

18 

7 

39 

C2 

14 

1 

7 

Intelligence 

56 

28 

50 

Mobility  and 

34 

14 

41 

survivability 

Combat  service 

4 

1 

25 

support 

Fire  support 

1 

0 

u 

Air  defense 

0 

0 

0 

Total 

127 

51 

Percent:  40 

The  SMEs  and  the  Rangers  felt  that  most  of  the  critical  information  was 
intelligence  information.  However,  the  SMEs  attached  more  importance  to  the  C2 
questions  than  the  Rangers  did.  When  the  Rangers'  ratings  were  sorted  by 
leaders  (squad  and  fire  team)  and  squad  members,  it  became  apparent  that  the 
C2  questions  were  more  critical  to  the  leaders  than  they  were  to  the  squad 
members.  The  squad  members  were  only  concerned  with  the  location  of  the 
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OpFor  on  the  squad  objective.  Additionally,  the  leaders  were  concerned  with 
such  information  as  who  was  currently  in  command  of  the  platoon,  the 
disposition  of  the  company  CCP,  the  location  of  the  company  CCP,  and  the 
location  of  the  company  POWs. 

4.3.2  Assessment  of  Knowledge  Questionnaire 

Appendix  B,  Section  4  displays  the  correct  responses  to  each  of  the  critical 
questions  on  the  assessment  of  knowledge  questionnaires.  The  results  from 
questions  that  were  not  determined  to  be  critical  were  removed  before  the 
analysis  of  the  results,  along  with  incomplete  data.  The  questions  that  were 
included  in  the  analysis  are  displayed  in  the  shaded  areas.  The  mean  percentage 
of  correct  responses  to  the  critical  questions  during  each  condition  (baseline  and 
technology)  is  given  in  Table  12. 

Table  12.  Mean  Percentage  of  Correct  Responses  to  Phase  II  Critical 
SA  Questions  With  and  Without  Radios 


X 

Day 

t 

P 

X 

Night 

t 

P 

X 

Total 

t 

P 

With  radio 

37.04 

1.52 

.133 

36.24 

2.56 

.012 

36.25 

3.16 

.002 

Without  radio 

33.68 

28.35 

30.74 

The  soldiers'  SA  was  not  significantly  better  with  the  radio  than  without  the 
radio  during  the  day.  It  was  significantly  better  at  night  with  the  radio  and 
overall,  it  was  significantly  better  with  the  radio.  This  finding  is  fairly  important 
because  the  conditions  of  this  experiment  were  probably  the  most  difficult  for 
showing  the  contribution  of  the  radio.  First  of  all,  the  MOUT  vignettes  required 
less  dispersion  than  several  other  tactical  situations  (i.e.,  reconnaissance,  "link¬ 
up,"  etc.)  so  the  soldiers  were  within  eye  contact  of  each  other  a  vast  majority  of 
the  time.  The  soldiers  used  in  the  experiment  (Rangers)  were  much  more 
experienced  in  MOUT  operations  than  were  typical  infantry  soldiers  and  were 
more  highly  trained  in  the  use  of  nonverbal  communications  such  as  hand  and 
arm  signals,  which  reduced  the  need  for  the  radio  in  many  instances.  Since  the 
conditions  of  this  experiment  were  probably  worst  case  for  showing  the 
contribution  of  the  radio  to  the  SA  of  a  squad,  the  significant  finding  is 
noteworthy. 

Table  13  displays  the  comparison  of  the  soldiers'  percentage  of  correct  responses 
to  the  SA  questions  during  the  day  and  night  vignettes,  with  and  without  radios. 
This  comparison  gives  insight  into  the  degradation  in  SA  experienced  by  soldiers 
during  periods  of  limited  visibility. 
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Table  13.  Comparison  of  SA  With  and  Without  Radios 


With  radio 

Without  radio 

X 

t 

P 

X 

t 

V 

Day 

37.19 

.41 

.681 

34.59 

2.19 

.031 

Night 

36.24 

28.44 

It  can  be  seen  that  without  radios,  there  is  a  significant  degradation  in  SA  at 
night  (the  percentage  of  correct  responses  falls  from  34.59  during  the  day  to  28.44 
at  night).  The  use  of  the  intra-squad  radio  negates  the  degradation  experienced  at 
night  (there  is  no  significant  difference  between  the  percentage  of  correct 
responses  to  the  SA  questions  during  daytime  and  nighttime  vignettes). 

4.3.3  Subjective  Questionnaires 

At  the  completion  of  each  vignette  in  Phase  II,  the  Rangers  were  asked  what 
things  they  considered  to  be  the  most  important  to  know.  Table  14  summarizes 
the  results  from  this  question  across  vignettes. 

Table  14.  Responses  to  Three  Most  Important  Things  You 
Need  to  Know,  Phase  n 


Action 

Number  of  responses 

Week  1  Week  2  Week  3 

Location  and  status  of  OpFor 

214 

151 

226 

Location  and  status  of  ExFor 

226 

182 

200 

ACE  report  information 

147 

61 

162 

Ensuing  mission 

67 

59 

22 

Status  of  COBs 

9 

20 

8 

CCP  location 

5 

21 

17 

Medevac 

18 

3 

24 

Primary  intelligence  requirements  (PIR) 

4 

5 

17 

Status  of  nerve  agent 

3 

2 

1 

Location  of  booby  traps 

9 

13 

9 

Status  of  HIP  helicopter 

1 

2 

3 

Source  of  fire 

6 

~ 

~ 

Building  security 

53 

3 

3 

During  Phase  11,  no  technological  effects  were  noted  regarding  what  the  Rangers 
believed  to  be  important  to  know.  Overwhelmingly,  the  Rangers  thought  the 
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most  important  things  they  needed  to  know  were  location  and  status  of  the 
OpFor  and  ExFor,  ACE  reports,  and  ensuing  missions.  The  first  squad  was  also 
keenly  interested  in  whether  the  building  was  secure.  A  complete  list  of  the 
Rangers'  responses  is  given  in  Appendix  B,  Section  5. 


When  asked  to  evaluate  their  SA  during  Phase  II,  the  Rangers  predominantly 
evaluated  themselves  as  aware  to  very  aware  (see  Table  15),  slightly  higher  than 
the  Rangers  during  Phase  I  (see  Table  9).  The  second  squad  (Week  2  of 
evaluation)  rated  themselves  as  less  aware  than  did  the  other  two  squads.  This 
may  be  an  indication  of  training  level  and  confidence.  A  complete  list  of  the 
Rangers'  comments  on  personal  SA  is  given  in  Appendix  B,  Section  5. 


Table  15.  Mean  Response  to  Ranger  Self-Evaluation  of  SA,  Phase  11 


Week  1 

Week  2 

Weeks 

Total  mean 

Radio 

No  radio 

Radio 

No  radio 

Radio 

No  radio 

Radio  No  radio 

Squad  1 

5.42 

5.34 

4.15 

5.07 

5.14 

5.22 

Squad  2 

4.53 

4.05 

5.04 

5.28 

4.69 

4.96 

Squad  3 

5.35 

4.77 

5.88 

5.07 

5.28 

4.91 

Mean 

5.20 

4.72 

5.03 

5.34 

5.04 

5.03 

5.19  4.99 

The  subjective  ratings  contrast  with  the  soldiers'  actual  SA  as  measured  on  the 
questionnaire  assessment  of  knowledge  (see  Table  12),  which  demonstrated  that 
the  soldiers  were  aware  of  just  a  little  more  than  one  third  of  the  critical 
information  that  they  needed  to  accomplish  their  objectives.  Once  again,  the 
respondents  were  not  "aware  that  they  were  unaware."  The  Rangers  rated 
themselves  slightly  more  aware  when  they  used  the  radio  (5.19)  than  when  they 
did  not  use  the  radio  (4.99).  This  is  an  indication  that  they  felt  the  radio  positively 
affected  their  SA.  Once  again,  these  subjective  ratings  of  SA  must  be  viewed  with 
caution.  Mean  responses  to  the  self-evaluation  of  SA  by  vignette  and  script  are 
given  in  Appendix  B,  Section  5. 

During  Phase  11,  the  Rangers'  sources  of  information  were  predominantly  voice 
commands,  followed  by  the  radio.  A  complete  list  of  Ranger  responses  to  source 
of  information  is  given  in  Appendix  B,  Section  5. 

4.3.4  OpFor  Questionnaire 

The  OpFor  indicated  that  the  Rangers'  self-discipline  during  communications 
was  very  poor  while  the  vignettes  were  being  conducted  in  Phase  E.  The  OpFor 
was  able  to  hear  the  Rangers  making  comments  in  50  of  the  72  vignettes.  They 
stated  that  the  Rangers  telegraphed  their  movements  and  plans  entirely  too 
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much,  even  when  they  had  the  radio.  When  the  OpFor  was  asked  to  rate  the 
Rangers'  overall  execution  of  each  mission,  they  rated  it  as  "good."  A  complete 
list  of  the  OpFor  comments  is  given  in  Appendix  B,  Section  6. 

4.3.5  End-of-Experiment  Questionnaire 

At  the  completion  of  Phase  II,  the  Rangers  rated  their  thoughts  about  the 
contribution  that  the  intra-squad  radio  made  to  their  personal  SA,  using  a  7-point 
scale  (7  being  the  extremely  better  than  no  radio  and  1  being  extremely  worse 
than  no  radio).  The  summation  of  these  ratings  is  given  in  Table  16.  Their  ratings 
showed  that  the  intra-squad  radio  was  "very  much"  to  "extremely  better"  than 
no  radio.  This  provides  another  indication  (in  addition  to  the  objective  SA 
results)  that  the  subjective  ratings  of  SA  must  be  interpreted  with  caution 
because  the  Rangers'  subjective  ratings  of  SA  (see  Table  15)  only  indicated  a 
slight  improvement  with  the  radio  (5.19  with  the  radio  versus  4.99  without  the 
radio).  Three  of  the  Rangers  stated  that  the  MOUT  tactical  mission  was  the  least 
useful  mission  in  which  to  use  the  intra-squad  radio  because  of  the  proximity  of 
the  squad.  They  believed  the  radio  would  be  more  effective  while  they 
performed  other,  more  dispersed  missions  such  as  patrolling.  Two  Rangers 
mentioned  that  the  radio  was  very  effective  in  finding  or  controlling  the  location 
of  the  squad  members.  Other  significant  comments  were  related  to  control  and 
dissemination  of  information.  A  complete  list  of  Ranger  comments  is  given  in 
Appendix  B,  Section  7. 

Table  16.  Contribution  of  the  Intra-squad  Radio  to  Personal  SA 


Weekl 

Week  2 

Week  3 

Squad  1 

5.89 

6.44 

6.89 

Squad  2 

6.44 

6.00 

6.78 

Squad  3 

5.70 

5.56 

6.56 

Throughout  the  experiment,  the  Rangers  complained  a  lot  about  the  ICOM  radio. 
When  asked  what  was  needed  to  improve  the  ICOM,  37  commented  that  the 
headset  needed  to  be  improved;  27  wanted  it  to  be  waterproof;  19  wanted 
increased  range;  15  wanted  the  radio  to  be  smaller;  7  complained  about  batteries 
and  battery  life;  and  4  complained  about  all  the  connecting  wires.  One  platoon 
had  previously  purchased  small  Motorola  radios  with  their  own  money  because 
of  their  displeasure  with  the  ICOM.  Conversely,  five  believed  it  was  fine  and  that 
nothing  could  be  improved.  Several  Rangers  had  purchased  a  low  cost  headset 
from  Radio  Shack  to  use  on  their  ICOM  radios.  Most  really  disliked  the  batteries 
and  wanted  something  with  AA  batteries,  and  all  complained  about  the  poor 
level  of  waterproofing  on  the  ICOM.  A  complete  list  of  Ranger  comments  is 
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presented  in  Appendix  Section  7,  and  in  the  results  of  the  end-of-experiment 
questionnaire. 


5.  Discussion 


The  use  of  the  AC  rather  than  a  free-play  exercise  resulted  in  fewer  uncontrolled 
variables  but  realism  was  retained.  The  tactics,  motivation,  and  reaction  of  the 
OpFor  as  well  as  the  location  of  enemy  contact  were  held  constant  by  the  use  of 
scripted  OpFor  movement.  The  length  of  time  required  to  complete  a  vignette 
was  reduced  and  held  constant.  The  vignettes  contained  only  the  high  intensity 
portions  of  a  scenario,  thus  reducing  the  time  required  for  an  iteration,  and  the 
scripts  held  the  time  constant  between  iterations.  The  capabilities  of  the 
leadership  at  platoon  and  higher  levels  were  held  constant  by  the  use  of  a 
scripted  white  cell  at  the  platoon  and  higher  levels.  Phase  I  of  the  experiment 
addressed  the  radio  TTPs  used  by  the  squads  and  platoons.  The  baseline  TTP 
was  most  frequently  reported  by  the  Ranger  participants  as  the  one  that  they  use. 
The  baseline  TTP  resulted  in  significantly  higher  SA  than  each  of  the  other  four 
TTPs  investigated  and  was  brought  forward  into  Phase  II  of  the  experiment  and 
held  constant.  Although  TTP  1  did  not  allow  as  much  information  to  be  passed 
over  the  squad  network,  the  information  that  was  passed  (i.e.,  orders  from  the 
squad  leader  and  mission-essential  information  from  the  platoon  leader  that  was 
passed  by  the  squad  leader)  was  critical  to  the  conduct  of  the  mission.  This 
limited  the  potential  for  cognitive  overload.  The  other  TTPs  allowed  a  lot  more 
information  to  be  passed,  but  much  of  it  was  not  critical.  This  may  have  reduced 
the  ability  of  the  squad  members  to  retain  the  details  of  the  critical  information.  It 
may  also  be  that  squad  members  "timed  out"  some  of  the  information  that  was 
passed  when  the  other  TTPs  were  used  because  they  knew  that  much  of  it  was 
not  critical. 

The  SMEs  and  the  Rangers  indicated  that  most  of  the  critical  questions  were  from 
the  intelligence  BOS  category.  Although  the  SMEs  included  14  C2  questions,  the 
Rangers  indicated  that  only  one  of  them  was  critical.  When  the  squad  members' 
ratings  were  excluded,  the  leaders  (squad  and  fire  team)  indicated  that  four  C2 
questions  were  critical.  This  demonstrates  that  it  is  important  to  tailor 
information  by  echelon.  Information  that  is  not  important  at  one  echelon  may  be 
critical  at  another  echelon.  The  combat  service  support  question  that  was  rated  as 
critical  by  the  Rangers  concerned  the  ammunition  status  of  the  squad. 

The  data  in  Phase  11  indicated  that  the  intra-squad  radio  significantly  contributed 
to  the  SA  of  the  Ranger  squad.  The  conditions  under  which  the  radio  was 
evaluated  were  probably  the  most  difficult  for  the  radio  to  show  improvement  in 
squad  SA.  The  squad  members  were  not  dispersed,  the  AC  vignettes  were  the 
high  intensity  portions  of  the  scenarios,  and  the  Rangers  were  highly  trained  in 
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silent  communications  (and  thus  not  as  dependent  on  verbal  communications).  It 
is  not  surprising  that  the  improvement  in  SA  was  much  greater  at  night  than  in 
the  day.  During  the  day,  the  Rangers  were  able  to  see  each  other  and 
communicate  using  hand  and  arm  signals.  At  night,  they  had  to  use  an  alternate 
means  of  communication  (the  radio). 

The  SA  AC  methodology  showed  good  discriminate,  face,  and  content  validity.  It 
was  able  to  discriminate  among  five  different  TTPs  and  between  daytime  and 
nighttime  conditions.  The  Rangers  indicated  that  the  realism  of  the  vignettes  was 
high  and  that  the  vignettes  provided  good  practice  for  them. 


6.  Recommendations 


The  TTP  chosen  for  use  in  Phase  II  of  this  experiment  may  not  be  valid  for  all 
vignettes  and  conditions.  An  ensuing  experiment  needs  to  be  conducted  to 
evaluate  the  SA  of  squads  using  radios  in  more  dispersed  vignettes.  The  squads 
used  for  the  ensuing  experiments  should  also  be  less  experienced  than  the 
Rangers.  This  would  give  an  indication  of  whether  the  TTPs  should  depend  on 
the  condition  in  which  an  exercise  takes  place. 
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SECTION  1 


CRTTiCAL  INFORMATION  REQUIREMENTS 
SCALE 


1  -  Extremely  unnecessary  for  performance 

2  -  Very  unnecessary  for  performance 

3  -  Unnecessary  for  performance 

4  -  Neutral 

5  -  Necessary  for  performance 

6  -  Very  necessary  for  performance 

7  -  Extremely  necessary  for  performance 


Vignette  A 


Vignette 

Sample 

Question 

Mean 

Size 

Question 

A3Q10 

6.06 

31 

Any  reports  of  OpFor  using  booby  traps  in  McKenna? 

A2Q08 

6.00 

37 

What  is  your  squad's  5.56-mm  (ball)  ammunition 
status? 

A1Q06 

5.82 

38 

Where  were  the  OpFor  located  in  C4? 

A5Q03 

5.80 

41 

If  used,  where  were  the  booby  traps  found? 

A5Q08 

5.78 

41 

Any  OpFor  in  C4;  if  so,  how  many /what  size  unit? 

A4Q08 

5.77 

39 

How  many  OpFor  were  seen/ reported  in  C4? 

A2Q06 

5.75 

36 

Three  OpFor  escaped  from  C3,  where  did  they  go? 

A4Q03 

5.64 

39 

Any  reports  of  OpFor  using  booby  traps? 

A5Q06 

5.59 

41 

What  direction  is  OpFor  moving  (vicinity  of 
cemetery)? 

A2Q03 

5.49 

37 

Any  reports  of  OpFor  using  NBC? 

A4Q01 

5.41 

39 

Most  likely  source  of  NBC  attack? 

A4Q11 

5.34 

38 

Where  is  tire  OpFor  NBC  lab  located? 

A4Q10 

5.33 

39 

Anything  of  intelligence  value  foimd? 

A3Q01 

5.32 

31 

Current  location  of  Platoon  CCP/POW? 

AlQOl 

5.29 

38 

OpFor  reinforcement  time? 

A2Q05 

5.27 

37 

If  reported,  what  are/were  OpFor  doing? 

A1Q09 

5.26 

38 

What  items  of  intelligence  value  were  fovmd? 

C4  =  command,  control,  communications,  and  computers 
C3  =  command,  control,  and  communications 


NOTE:  Under  the  Vignette  Question  columns  above/below,  the  letter  represents 
the  vignette  and  the  number  represents  the  Script,  e.g.,  B  (vignette),  3(script). 
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Vignette  B 


Vignette 

Question 

Mean 

Sample 

Size 

Question 

B2Q08 

6.05 

38 

Do  you  have  a  chemical  threat? 

B2Q02 

6.05 

38 

How  many  OpFor  located  in  vicinity  of  B2? 

B2Q06 

6.00 

38 

What  should  your  MOPP  status  be  at  tins 
time? 

B5Q02  ■ 

5.98 

41 

How  many  OpFor  are  in  B2? 

B3Q03 

5.97 

38 

How  many  OpFor  were  in  vicinity  of  Bl? 

B3Q11 

5.82 

38 

Status  of  5.56-mm  ball  ammunition? 

B1Q06 

5.82 

38 

How  many  OpFor  were  seen/reported  in 
vicinity  of  A2/ A4? 

B3Q02 

5.72 

38 

When  do  you  expect  counterattack  from 
east? 

B3Q05 

5.66 

38 

How  many  OpFor  in  vicinity  of  C4? 

B2Q11 

5.66 

35 

Where  were  chemical  weapons  used/ 
reported? 

B5Q07 

5.63 

41 

Cause  of  explosion  in  stairwell  of  building 

A3? 

B2Q01 

5.63 

38 

Length  for  OpFor  to  reinforce  their  units? 

B2Q03 

5.63 

38 

Where  did  OpFor,  reported  vicinity  of 
building  C6,  go? 

B3Q12 

5.61 

38 

20-30  OpFor  currently  reported  where? 

B4Q03 

5.55 

38 

Where  did  OpFor  seen  in  wood  line  east  of 
McKenna  go? 

B1Q05 

5.49 

39 

Likely  location  of  OpFor  reinforcements? 

B4Q07 

5.47 

38 

Disposition  of  platoon  sergeant? 

BlQOl 

5.38 

39 

How  long  for  OpFor  reinforcement 
capability  on  objective? 

B4Q02 

5.34 

38 

According  to  INSUM,  where  is  large 
number  OpFor? 

B2Q04 

5.34 

38 

What  t3rpe  reinforcements  does  OpFor 
have? 

B5Q08 

5.32 

41 

What  is  your  most  recent  follow-on 
mission? 

B3Q08 

5.29 

38 

How  far  have  OpFor  advanced?? 

INSUM  =  intelligence  summary 
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Vignette  C 


Vignette 

Question 

Mean 

Sample 

Size 

Question 

C3Q06 

6.10 

30 

Status  of  two  OpFor  soldiers  attacking  C3? 

C2Q01 

5.95 

38 

Probability  OpFor  has  booby  trapped  C4? 

C4Q05 

5.92 

38 

Disposition  of  OpFor  in  C3  when  you 
entered? 

C3Q05 

5.90 

30 

Limitations  on  securing  building  C3  and 
church? 

C5Q06 

5.80 

41 

Flow  many  OpFor  are/were  in  C3? 

C2Q08 

5.79 

38 

What  is  biggest  threat  from  OpFor 
according  to  INSUM? 

C3Q03 

5.73 

30 

Status  of  the  OpFor  between  C3  and  C4? 

ClQOl 

5.71 

38 

Flow  long  for  OpFor  to  reinforce  with 
squad? 

C1Q07 

5.66 

38 

Does  OpFor  have  capability  to  reinforce 
with  platoon? 

C5Q07 

5.56 

41 

Any  intelligence  value  found  in  C3? 

C1Q08 

5.53 

38 

Where  did  the  escaping  OpFor  go? 

C5Q04 

5.51 

41 

Flow  many  OpFor  were  seen  moving  from 

A4  to  B2? 

C4Q02 

5.47 

38 

What  size  OpFor  element  available  for 
coimterattack? 

C4Q01 

5.45 

38 

What  type  coimterattack  does  your  element 
expect? 

C2Q09 

5.45 

38 

Disposition  of  OpFor  in  Bldg  C3  during 
squad  attack? 

C1Q04 

5.37 

38 

Fiow  many  OpFor  were 

FOA/WIA/captured  in  C3? 

C4Q06 

5.30 

37 

Disposition  of  OpFor  in  C3  now? 

C2Q04 

5.29 

38 

What  is  the  most  probable  OpFor  mission? 
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SECTION  2 


EXPERIMENTAL  MATRIX,  SAMPLE  QUESTIONNAIRE,  AND  SCRIPT 


Trial 

Squad 

TTP 

Vig 

Script 

Trial 

Squad 

Radio 

Vig 

Script 

01 

1 

1 

A 

1 

41 

1 

3 

c 

3 

02 

2 

2 

B 

3 

42 

2 

4 

A 

5 

03 

3 

3 

C 

5 

43 

3 

5 

B 

2 

04 

4 

4 

A 

2 

44 

4 

1 

C 

4 

05 

5 

5 

B 

4 

45 

5 

2 

A 

1 

06 

1 

1 

B 

1 

46 

1 

4 

A 

4 

07 

2 

2 

c 

3 

47 

2 

5 

B 

1 

08 

3 

3 

A 

5 

48 

3 

1 

C 

3 

14* 

4 

4 

C 

2 

49 

4 

2 

A 

5 

10 

5 

5 

C 

4 

50 

5 

3 

B 

2 

11 

1 

1 

C 

1 

51 

1 

4 

B 

4 

12 

2 

2 

A 

3 

52 

2 

5 

C 

1 

13 

3 

3 

B 

5 

53 

3 

1 

A 

3 

09* 

4 

4 

B 

2 

54 

4 

2 

B 

5 

15 

5 

5 

A 

4 

55 

5 

3 

C 

2 

16 

1 

2 

A 

2 

56 

1 

4 

C 

4 

17 

2 

3 

B 

4 

57 

2 

5 

A 

.  1 

18 

3 

4 

C 

1 

58 

3 

1 

B 

3 

19 

4 

5 

A 

3 

59 

4 

2 

C 

5 

20 

5 

1 

B 

5 

60 

5 

3 

A 

2 

21 

1 

2 

B 

2 

61 

1 

5 

A 

5 

22 

2 

3 

C 

4 

62 

2 

1 

B 

2 

23 

3 

4 

A 

1 

63 

3 

2 

C 

4 

24 

4 

5 

B 

3 

64 

4 

3 

A 

1 

25 

5 

1 

C 

5 

65 

5 

4 

B 

3 

26 

1 

2 

C 

2 

66 

1 

5 

B 

5 

27 

2 

3 

A 

4 

67 

2 

1 

C 

2 

28 

3 

4 

B 

1 

68 

3 

2 

A 

4 

29 

4 

5 

C 

3 

69 

4 

3 

B 

1 

30 

5 

1 

A 

5 

70 

5 

4 

C 

3 

31 

1 

3 

A 

3 

71 

1 

5 

C 

5 

32 

2 

4 

B 

5 

72 

2 

1 

A 

2 

33 

3 

5 

C 

2 

73 

3 

2 

B 

4 

34 

4 

1 

A 

4 

74 

4 

3 

C 

1 

35 

5 

2 

B 

1 

75 

5 

4 

A 

3 

36 

1 

3 

B 

3 

76** 

1 

1 

A 

1 

37 

2 

4 

C 

5 

77** 

2 

2 

B 

3 

38 

3 

5 

A 

2 

78** 

3 

3 

C 

5 

39 

4 

1 

B 

4 

79** 

4 

4 

A 

2 

40 

5 

2 

C 

1 

80** 

5 

5 

B 

4 

Out  of  sequence  because  of  training  on  McKenna 
**Re-run  of  E- trials  1-5 
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SAMPLE  QUESTIONNAIRE  AND  SCRIPT  A-1 


ID#: _ 

NAME: _ RANK: _  YRS  IN  ARMY: _ 

UNIT: _  DATE: _ 

Please  answer  the  following  questions  based  on  your  experience  with  the  system. 
Answer  all  questions  as  accurately  as  possible.  Circle  the  appropriate  letter. 

1.  How  long  will  it  take  the  OpFor  to  reinforce  their  units  currently  in 
McKerma? 

a.  Less  than  1  hour 

b.  1-2  hours 

c.  2-3  hours 

d.  No  reinforcements  available 

e.  Don't  know 

2.  What  t5q?e  of  reinforcements  does  the  OpFor  have? 

a.  Motorized  Infantry 

b.  Air  Assault  Infan^ 

c.  Irregulars 

d.  None 

e.  Don't  know 

3.  What  was  the  location  of  the  HIP  Helicopter  when  first  reported? 

a.  15K  north  of  McKerma 

b.  5K  north  of  McKerma 

c.  5K  east  of  McKerma 

d.  15K  east  of  McKerma 

e.  Don't  know 

4.  What  is  the  latest  reported  disposition  of  the  HIP  helicopter? 

a.  Flying  south  5K  east  of  McKerma 

b.  Landed  east  end  of  McKerma  Airstrip  debarking  troops 

c.  Landed  east  end  of  Kings  Pond 

d.  Shot  down  by  AC-130 

e.  Don't  know 

5.  How  many  KLA/WIA  did  A  Company  receive  from  the  marksman  in  the 
steeple? 

a.  2KIA,2WIA 

b.  1  KIA,  1  WIA 

c.  0KIA,2WIA 

d.  2  KIA,  0  WIA 

e.  Don't  know 

6.  WTrere  were  the  OpFor  located  in  C4? 

a.  Window  2-1  &  2-2 

b.  Window  2-6  &  2-7 

c.  Window  2-2  &  2-7 

d.  None  reported 

e.  Don’t  know 
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7.  How  many  ExFor  KIA/ WIA,  if  any,  does  3rd  Squad  have  at  this  time? 

a.  0  BOA,  2  WIA 

b.  1  KIA,  1  WIA 

c.  2  KIA,  0  WIA 

d.  None  reported 

e.  Don't  Know 

8.  Where,  if  any,  were  the  COBs  seen/ reported? 

a.  InC3 

b.  Running  from  C3  to  C4 

c.  In  B1 

d.  None  seen/reported 

e.  Don't  know 

9.  What  items,  if  any,  of  intelligence  value  were  foimd,  on  your  objective? 

a.  Map  with  ExFor  positions 

b.  Map  with  OpFor  positions 

c.  Roster  of  OpFor  personnel 

d.  Nothing  found 

e.  Don't  know 

10.  Where  is  the  platoon  leader  located? 

a.  Enroute  to  your  location 

b.  With  1st  Squad 

c.  With  2nd  Squad 

d.  At  Company  CP 

e.  Don't  know 

11.  What  is  the  status  of  the  SAW's  in  2nd  platoon? 

a.  1  SAW  Inop 

b.  Both  SAW's  Inop 

c.  No  reported  ch^ge  in  SAW  status 

d.  SAW's  can  not  engage  at  this  time 

e.  Don't  know 
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QUESTIONNAIRE  MATRIX 
Script  1,  Vignette  A 


Per-  Com-  Mobility  Combat 

cep-  prehen-  Projec-  Maneu-  Intelli-  &  Surviv-  Service  Fire  Air 

tion  sion  tion  ver  C2  gence  ability  Support  Support  Defense 


Q1  A  V 

Q2  B  V 

Q3  C  g  V 

Q4  B  «  V 

Q5  B  V 

Q6  B  V 

Q7  A  V 

Q8  B  V 

Q9  B  V 

QIO  B  V 

Qll  C  V 
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SCRIPT  1 


SQDLDR 

SPTSQD 

PLT  /  WC  (3rd  SQD, 
Reserve) 

Time 

(IstSQD) 

(2nd  SQD) 

OpFor/COB 

ATK 

East  rooms 

West  end  of  Cl 

1  OpFor  in  steeple 

H  Hour  - 
^Building  C2 
will  have 
concertina  all 
around 
except  side 
with  door  N, 

E,  W 

From  Cl 
toC2 

of  Cl 

1  OpFor  in  room  1/C2 

1  OpFor  in  room  3/C2 

3  OpFor  in  C4 
(window  2-6, 2-7  with 
weapon) 

2  COBs  in  C3 

OpFor  room  1  &  3  fight 
to  death 

All  doors  open  in  C2 

Init  attack 

Obs  and 

INSUM  two  motorized 

Dead  OpFor  in  room  3 
will  have  a  map  with 
the  OpFor  positions  on 
him/her  (Action) 
Steeple  marksman 

smoke 

Eng.  TO 

vehicles  reported 

exposed  shoots  targets 

+1  Min 

deployed 

vicinity  Pinetree  & 

of  opp  (Time) 

Hourglass  road 

RPT:  fflP  HeUcopter 
reported  5K  East  of 
McKenna  moving 
South  West 


Move 

Obs  and 

Company  CCP  co¬ 

2  COBs  run  from  C3  to 

+1-3  Min 

from  Cl 
toC2 

Eng.  TO 

located  with  Platoon 
CCP/POW 

A  Company  imder  fire 
from  church  steeple  1 
KIA,1WTA 

Report:  Support  Squad 
has  OpFor  in  steeple 
imder  fire 

C4  into  door  A  (Time) 

OpFor  exposed  in  NE 
window  room  3,  C2, 
when  Rangers  enter 
building  (Action) 

Move 

Obs  and 

MSG:  3  OpFor  seen  in 

Steeple  marksman 

+3-5  Min 

from  Cl 
toC2 

Eng.  TO 
(If  Support 
Squad  sees 
OpFor  in 

C4,  Report 
to  Squad 
Leader) 

C4  (window  2-6  &  2-7) 

INSUM  doctor 
believed  to  be  in  C4. 
OpFor  seen  in  NE 
window  building  C2 

taken  out  (Action) 

3  OpFor  in  C4,  window 
2-6  &  2-7,  fire  on  ExFor 
(Time) 

Prepare/ 

Obs  and 

Request  situation 

2  OpFor  in  C2  fight  to 

+5-10  Min 

enter  C-2 
(doors  to 
other 
rooms, 
closed) 

Eng.  TO 

report  (SITREP)  if 
support  squad  does 
not  report  then  WC 
MSG:  2  COBs  seen 
running  from  C3  to  C4 

RPT:  HIP  landed  East 

the  death  (Action) 

end  of  McKenna 
airstrip,  debarking 
troops 
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SCRIPT  1  (continued) 


Time 


SQDLDR  SPTSQD 
(IstSQD)  (2ndSQD) 


PLT/WC(3rdSQD, 

Reserve) 


Secure  Obs  and  3^“*  Squad  2  WIA  to 

objective  Eng.  TO  booby  traps 


OpFor/COB 


+10-15  Min 


Platoon  leader  has 
moved  to  C3  to 
evacuate  causalities 


A  Company  reports 
doctor  seen  in  B1 


Motorized  vehicles 
turning  east  on 
Hourglass  road 

Request  ACE  report 


TO  =  targets  of  opportunity 


SECTION  3 


RESULTS  FROM  DEMOGRAPHIC  QUESTIONNAIRE 
SAMPLE  SIZE  =  42 

RANK  AGE  DUTY  POSITION 

FOR  THIS  EXPERIMENT 


E-2-  6 

Mean  =  22 

Squad  Leader 

-  5 

E-3  - 15 

(Range  18  to  34) 

Team  Leader 

-10 

E-4-12 

Rifleman 

-  8 

E-5-  7 

Grenadier 

-10 

E-6-  2 

SAW 

-  9 

1.  Handedness:  39  Right  ^Left 

2.  Height:  Mean  =  70  inches  (Range  66  to  75) 

Weight:  Mean  =  171  pounds  (Range  145  to  220) 

3.  Vision: 

a.  Is  your  vision  in  each  eye  20/20  or  correctable  to  20/20?  .40.  Yes  No  X  NR 

b.  Do  you  wear  glasses  when  performing  military  duties?  10  Yes  30  No  X  NR 

c.  Do  you  wear  contact  lenses  when  performing  military  duties?  7_  Yes  32  No 

J.NR 

4.  Education:  Mean  =  12.7  years 

5.  Current  Military  Occupational  Specialty  (MOS)  Months  (mean)  in  Current  MOS 

1  IB  -  33  23  months 

lie  -  9 

6.  Months  (mean)  in  current  job  =  11  months 

7.  Months  (mean)  of  experience  in  infantry-related  MOS  =  23  months 

8.  Months  (mean)  of  military  service  =  26  months 

9.  Months  (mean)  in  these  leadership  positions: 

a.  Fire  Team  Leader  =  3  months 

b.  Squad  Leader  =  2  months 

10.  Months  (Mean)  of  military  training /instruction  received  in  light  infantry 
operations: 

a.  Classroom  training  at  Infantry  school: 

3  months 

b.  Field  exercises  (i.e.,  NTC,  JOTC,  CRTC,  JRTC,  MOUT  training): 

3  months 
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11.  Months  (mean)  of  military  training/instruction  received  in  the  following 
areas: 


a.  Land  navigation  (map  reading,  use  of  GPS  data,  following  planned 

route):  5  months 

b.  Route  planning:  3  months 

c.  Communications;  3  months 

12.  GT  Score  (Mean)  =  115 

13.  Latest  Physical  Fitness  (PFT)  Score  (mean)  = 

286  (out  of  300) 

14.  Latest  Firing  Qualification  Test  (FQT)  Score 

(mean)  =  36  (out  of  40) 

Type  of  weapon: 

(How  many  used) 


M4  -31  M240  -  5 

SAW  -  2  NR  -  1 

M16  -  3 
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15.  Self  rating  of  Knowledge,  Skills,  and  Abilities  (KSA)  related  to  Infantry 
duties: 

1  2  3  4  5 

Below  Average  Above  Outstanding 

Poor  Average  Average 

MEAN  RESPONSE 

Knowledge  of  Infantry  TTPs.  3.53 

Knowledge  of  computers.  2.67 

Knowledge  of  electronics.  2.64 

Knowledge  of  mechanics  and  maintenance  procedures  for  weapon  2  55 

systems  and  equipment  used. 

Knowledge  of  map  reading  and  orientation  in  field  setting.  3.81 

Knowledge  of  land  navigation.  3.81 

Knowledge  of  reconnaissance,  surveillance,  and  target  acquisition  2.98 

procedures. 

Knowledge  relating  to  communications  equipment  and  communications  2  83 
procedures. 

Marksmanship  skills.  3.98 

Map  reading  skills.  3.88 

Land  navigation  skills.  3.76 

Computer  skills  (keyboards,  mouse,  track  balls,  navigating  in  and  out  of  3  ^7 
menus,  etc.). 

Communication  skills  (ability  to  use  communications  equipment  and 
face-to-face  communications  to  enhance  mission  accomplishment).  3.19 

Leadership  skills  3.48 

16.  a.  Months  (Mean)  of  military  deplo5Tnent  for 

peacekeeping,  peace  enforcement,  and  stability 
operations  of  combat:  0 

b.  If  so,  where?  NA 
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SECTION  4 


RESULTS  FROM  ASSESSMENT  OF  KNOWLEDGE  QUESTIONNAIRE 
NUMBER  OF  CORRECT /INCORRECT  RESPONSES 


Questions 

TTP 

1 

5 

4 

3 

2 


Vignette  A  -  Script  1 

Q1  Q6 

Sqd  C  I  C  I 

V*  5  2  6  1 

2'”'  6  2  8  0 

3'‘‘  4  15  0 

4"’  3  4  6  1 

5*''  3  5  5  3 


Q9 

C  I 

3  4 

0  8 
1  4 

1  6 

4  4 


Vignette  A  -  Scnpt  2 


Questions  Q2 

TTP  Sqd  C  I 

2  1*'  2  4 

12"*'  3  4 

5  3"*  5  1 

4  4"'  14 

3  S'*  0  9 


Q3  Q5  Q6 

C  I  C  I  C  I 

3  3  1  5  3  3 

3  4  4  3  2  5 

2  4  3  3  5  1 

4  1  0  5  3  2 

6  3  0  9  4  5 


Questions 

TTP 

3 
2 
1 
5 

4 


Vignette  A  -  Script  3 

Q1  Q8  QIO 

Sqd  C  I  C  I  C  I 

r‘  4  3  3  4  4  3 

2’“'  16  16  0  7 

S'"  4  3  2  5  0  7 

4"’  1  7  3  5  1  7 

S'*  3  5  2  6  0  8 


Questions 

TTP  Sqd 


Vignette  A  -  Script  4 

Q3  Q4  Q8  QIO  Qll 

C  I  C  I  C  C  I  C  I 

I 


4  r* 

3  I"" 

2  3'" 

1  4"' 

5  S'* 


523416434 

088017083 

246024064 

637236543 

181845273 


Vignette  A  -  Script  5 


Questions  Q3 

TTP  Sqd  C  I 

5  1*'  3  5 

4  2’"'  5  3 

3  3'"  4  2 

2  4'*  9  0 

1  S'*  7  1 


Q4  Q6  Q8 
Cl  Cl  Cl 

4  4  3  5  1  7 
0  8  2  6  1  7 
1  6  2  4  1  5 
1  8  2  7  1  8 
0  8  4  4  4  4 
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ON  ON  K)  Ol  CO 


cn  M  to 


Vignette  B 


Questions 

TTP 

1 

5 

4 

3 

2 


Vignette  B  -  Script  1 
Q1  Q5 

Sqd  C  I  C  I 

1*'  4  4  4  4 

2"“'  2  6  17 

3'"  3  4  0  7 

4""  3  4  0  7 

5^  7  2  2  7 


Q6 

C  I 
7  1 

3  5 

2  5 

2  5 

2  7 


Questions 

TTP  S<jd 

r‘ 

2pd 
yd 


Questions 

TTP 

3 
2 
1 
5 

4 


Vignette  B  -  Script  2 

Q1  Q2  Q3 

Cl  Cl  Cl 

2  5  3  4  2  5 

4  4  5  3  1  7 

3  3  2  4  2  4 

4  4  4  4  2  6 

5  4  3  6  4  5 

Vignette  B  -  Script  3 
Q2  Q5 

Sqd  C  I  C  I 

1*'  16  16 

2"“'  4  3  2  5 

3'^^  0  6  4  2 

4"'  18  2  7 

S""  17  0  8 


Q6  Q8 
C  I  C  I 

7  0  3  4 
17  6  2 
0  6  0  6 
17  6  2 
4  5  2  7 


Q8 

C  I 
1  6 
0  7 

2  4 
1  8 

3  5 


Questions 

TTP  Sqd 

4  r’ 

3  2"'' 

2  3"* 

1  4"" 

5  S'" 


Questions 

TTP  Sqd 

5  r' 

4  2"*' 

3  3'" 

2  4"' 

1  5'* 


Vignette  B  -  Script  4 


Vignette  B  -  Script  5 

Q1  Q2 

C  I  C  I 

6  2  2  6 

3  5  5  3 

2  5  16 

5  4  5  4 

4  5  4  5 


Q7  Q8 
C  I  C  I 

5  3  8  0 
17  2  6 
0  7  2  5 
5  4  4  5 
8  13  6 
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Vignette  C 


Questions 

TIP 

1 

5 

4 

3 

2 


Sqd 

r‘ 

3"‘ 

^tk 

S'* 


Vignette  C  -  Script  1 

Q1  Q2  Q4 

C  I  C  I  C  I 

5  2  6  1  3  4 

17  17  3  5 

2  5  5  2  4  3 

0  7  1  6  5  2 

9  0  2  7  2  7 


Q7  Q8 

C  I  C  I 

16  0  7 

2  6  0  8 

2  5  16 

16  16 

3  6  6  3 


Questions 

TTP  Sqd 

2  1*' 

1  2”^ 

5  3'“ 

4  4"’ 

3  S'* 


Vignette  C  -  Script  2 

Q1  Q3  Q4 

C  l  C  l  C  l 

5  2  0  7  0  7 

5  3  3  5  0  8 

3  3  15  15 

17  18  0  8 

7  2  0  9  1  8 


Q8  Q9 

C  I  C  I 

5  2  6  1 

6  2  8  0 

4  2  5  1 

6  2  7  1 

9  0  7  2 


Questions 

TTP  Sqd 

3  1*' 

2  2"'' 

1  S"* 

5  4"’ 


Vignette  C  -  Script  3 

Q2  Q3 

C  I  C  I 

7  0  4  3 

8  0  0  8 

7  0  2  5 

9  0  9  0 


Q5  Q6 

C  I  C  I 

2  5  2  5 

0  8  17 

7  0  3  4 

3  6  0  9 

8  0  0  8 


Questions 

TTP 

4 
3 
2 
1 

5 


Vignette  C  -  Script  4 

Ql  Q2 

Sqd  C  I  C  I 

1“  7  0  5  2 

2"*'  5  2  4  3 

3"*  5  115 

4'*  7  2  2  7 

S'*  7  2  18 


Q5 

C  I 

6  1 
6  1 
5  1 

8  1 
8  1 


Questions 

TTP  Sqd 

5  1“ 

4  2"'' 

3  3’'“' 

2  4"' 

1  5'* 


Vignette  C  -  Script  5 

Q4  Q5 

C  I  C  I 
16  16 

16  4  3 

15  3  3 

18  3  6 

17  2  6 


Q6  Q7 

C  I  C  I 

4  3  0  7 

2  5  0  7 

5  10  6 

5  4  18 

17  0  8 
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SOLDIER  COMMENTS  BY  TTP 


TTPl 

r*  Squad 

Not  familiar  with  the  window  numbering  system. 

3*^  Squad 

TTP  1  is  very  hard  for  the  squad  leader  because  he  has  to  use  his  eyes  to  see  if 
teams  are  doing  what  he  told  them. 

No  response  on  squad  radios  back  to  the  squad  leader  gives  me  an  uneasy 
feeling  that  they  might  not  hear  me. 

TTP  1  is  absolutely  the  worst  TTP;  communication  is  hindered  severely. 

All  information  oihei  than  from  higher  is  from  talking. 

TTP  1  is  combat  ineffective. 

}  YTP2  . '  . .  "  . . .  . . 

2”*^  Squad 

The  ICOM  would  not  be  in  use  that  much  in  this  TTP. 

During  the  confusion  of  the  battle,  verbal  or  face-to-face  would  be  used  more. 
Team  leaders  had  a  hard  time  disseminating  information  down  to  the  men  due 
to  fighting  the  fight  first. 

I  feel  the  ICOM  system  should  be  changed.  The  one  we  have  gets  in  the  way 
too  much,  and  is  not  stable  inside  the  Kevlar®.  I  think  a  throat  mike  and  ear 
piece  would  work  more  efficiently. 

I  didn't  know  much  of  what  was  going  on  with  B  team  or  with  the  remaining 
battle. 

Didn't  know  much  of  what  was  going  on  at  anyone  higher  than  my  squad 
leader. 

^:ttp3  . . 

3^^*  Squad 

ICOM  battery  died  in  middle  of  exercise. 

Lots  of  radio  traffic  from  platoon  leader  makes  it  hard  to  control  squad.  I  think 
TTP  3  contributes  to  this. 

During  TTP  3,  squad  leaders  have  to  move  a  lot  to  get  feedback. 

Team  leader  was  dead.  Often,  team  leader  was  next  to  me  whole  time.  No 
need  to  use  ICOM  when  the  soldier  you  are  talking  to  is  right  next  to  you! 
Doesn't  make  sense. 

TTP  3  squad  leader  put  his  comments  over  ICOM  to  squad  and  it  worked  very 
well. 

TTP  3  is  not  good  for  communication  when  squad  is  split  up. 

TTP  3  is  totally  pointless  because  it  will  never  happen. 

:TTP4 . 

2"^*  Squad 

Soldiers  were  not  able  to  speak  freely  when  they  were  in  a  bind  and  needed 
help. 

3“^  Squad 

TTP  4  seems  to  have  a  lot  of  redundant  radio  talk,  i.e.,  soldier  tells  team  leader, 
squad  leader  can  hear,  team  leader  relavs  anyway. 

:TTP5,,,  .  r;, . 

1"^  Squad 

ICOM  went  down  after  initial  contact.  Received  intelligence  by  over-hearing 
ICOM  and  by  search  of  EPWs. 

2"‘^  Squad 

This  data  set  will  be  misleading.  TTP  5  lacks  the  discipline  of  some  of  the 
other  TTPs.  While  I  received  more  information  from  higher  using  this  TTP,  I 
was  unable  to  have  the  desired  SA  for  the  simple  control  of  my  team.  From 
monitoring  the  ICOM  transmissions,  you  will  probably  note  that  we 
naturally  stuck  to  communications  between  team  members  and  there  was  no 
talk  between  teams;  however,  just  knowing  that  we  were  at  TTP  5  gave  team 
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members  the  notion,  they  could  broadcast  whenever  they  saw  something. 

The  airways  were  cluttered.  In  normal  training  situations,  the  squad  leader 
would  have  taken  control  of  the  net,  shutting  up  the  squad  members,  and 
demanding  information  only  from  team  leaders. 

3^**  Squad 

This  TTP  works  the  best  by  far.  1 

Squad 

So  much  happens  aU  at  once  and  all  you're  trying  to  do  is  stay  alive.  1 
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SECTIONS 


RESULTS  FROM  SUBJECTIVE  QUESTIONNAIRE 

2.  What  were  the  three  most  important  things  you  needed  to  know  at  the  end  of  the 
exercise? 


Ensuing  mission 
Location  and  status  of  ExFor 
Location  and  status  of  OpFor 
ACE  Report 
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Status  of  HIP 
Status  of  COBs 
Medevac 
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Location  and  status  of  all  squad 
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PIR 
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Status  of  nerve  agent 
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Location  and  status  of  OpFor 
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PIR 

CCP  Location 
Status  of  HIP 
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Medevac 

Location  of  booby  traps 
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Ensuing  mission 

Location  and  status  of  all  squad 
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PIR 

CCP  Location 
Status  of  COBs 
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Status  of  nerve  agent 
Location  of  booby  traps 
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Ensiling  mission 

Location  and  status  of  all  squad 

Location  and  status  of  OpFor 
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CCP  Location 

Status  of  COBs 
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would  you  rate  your  personal  situational  awareness  during  this  exercise? 


52 


Mean  Response 


in 

d 


0 


u 


d 


ift 

I 

pa 

rH 

Ph 


I 

< 


€M 

< 


rt 

CD 


IN 

VO 


o 

in 

in 


00 

00 


IN 

iri 


IN 

rH 

in 


CO 

in 


IN 

in 

ifj 


o 

in 

in 


On 

00 

iri 


LfJ 


o 

o 

in 


IN 

so 

in 


ON 

00 

CN 

CO 

iri 

iri 

iri 

IN 

00 

CO 

rH 

00 

so 

iri 

iri 

iri 

VO 

00 

in 


IN 

in 

in 


00 

00 


a 

•c 

y  CO 

“  CO 

^  PL. 

Bn 

*5  fc 

c  H 

.SPCQ 

> 


CQ 


in 

I 

< 


I 

< 


in 


Pn 

_  H 

VO  H 

in  ^ 

in 


in 

CN 

in 


00 

in 


in 

Pm 

s 


fe 

in 


IN 

'O 

in 


ON 

CN 

in 


so 

00 


o 

o 

s£5 


o 

o 

iri 


00 

00 

iri 


o 

in 

iri 


CO 

so 

iri 


o 

in 

iri 


IN 


^s 

in 


o 

in 


in 


CO 

so 

CO 

00 

00 

iri 

iri 

o 

o 

iri 


■?  *2  £  5 

evi  eo  ^  in 


IN 

t-H 

iri 


■g  *2  £  £ 

M  CO  ^  in 


o 

o 

so 


«  Is 

CN  CO 


^  in 


53 


NR  =  no  response 


!.  What  was  your  main  source  ofinformation  on  this  exercise? 
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SECTION  6 


RESULTS  FROM  OPFOR  QUESTIONNAIRE 

1.  Did  you  hear  any  commands  or  discussion  that  gave  you  information  on  what 
the  Rangers  intended  to  do  before  they  did  it? 
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I.  How  would  you  rate  the  Ranger's  execution  of  this  mission? 
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Results  from  OpFor  Questionnaire 

Results  from  End-of-Experiment  Questionnaire 
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SECTION  1 

CRITICAL  INFORMATION  REQUIREMENTS 
SCALE 


1  -  Extremely  iinnecessary  for  performance 

2  -  Very  unnecessary  for  performance 

3  -  Unnecessary  for  performance 

4  -  Neutral 

5  -  Necessary  for  performance 

6  -  Very  necessary  for  performance 

7  -  Extremely  necessary  for  performance 


VIGNETTE  A 


Vignette 

Sample 

Question 

Question 

Mean 

Size 

A1Q06 

5.68 

81 

Where  were  OpFor  located  in  C4? 

A4Q08 

5.46 

81 

How  many  OpFor  were  seen/ reported  in  C4? 

A4Q03 

5.43 

81 

Any  reports  of  OpFor  using  booby  traps? 

AlQOl 

5.11 

81 

OpFor  reinforcement  time? 

A4Q01 

5.04 

81 

Most  likely  source  of  NBC  attack? 

A1Q02 

5.02 

81 

Type  of  C^For  reinforcement? 

A4Q11 

4.94 

81 

Where  is  the  OpFor  NBC  lab  located? 

NOTE:  Under  the  Vignette  Question  columns  above /below,  the  letter  represents 
the  Vignette  and  the  number  represents  the  Script,  e.g.,  A  (vignette),  1  (script). 

VIGNETTE  B 


Vignette 

Question 

Mean 

Sample 

Size 

Question 

B3Q11 

5.69 

81 

Status  of  5.56-mm  ball  ammunition? 

B1Q06 

5.59 

81 

How  many  OpFor  seen/ reported  in  vicinity  of 
A2/A4? 

B3Q03 

5.51 

81 

How  many  OpFor  were  in  vicinity  of  Bl? 

BlQOl 

5.48 

81 

OpFor  reinforcement  capability  on  objective 
time? 

B1Q05 

5.42 

81 

Likely  location  of  OpFor  reinforcements? 

B3Q02 

5.30 

81 

When  do  you  expect  counterattack  from  east? 

B3Q05 

5.26 

81 

How  many  OpFor  in  vicinity  of  C4? 

B3Q12 

5.16 

75 

20-30  OpFor  are  currently  reported  where? 

B1Q02 

5.07 

80 

Platoon  CCP/POW  currently  located? 

B1Q08 

4.95 

81 

What  was  reported  in  vicinity  of  east  end  of 
airstrip? 

B3Q08 

4.90 

81 

How  far  have  ttie  20-30  OpFor  advanced? 
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VIGNETTE  C 


Vignette 

Question 

Mean 

Sample 

Size 

Question 

C2Q08 

5.68 

81 

Biggest  threat  from  OpFor  according  to 
INSUM? 

C2Q01 

5.65 

81 

Probability  that  OpFor  has  booby-trapped  C4? 

C4Q02 

5.33 

81 

Size  OpFor  element  available  for 
coimterattack? 

C4Q01 

5.28 

81 

T5^e  coimterattack  your  element  expects? 

C4Q04 

5.19 

81 

./Giy  reports  of  platoon  element  in/around 
McKenna? 

C4Q05 

5.19 

81 

Disposition  of  OpFor  in  C3  when  you 
entered? 

VIGNETTE  D 

Vignette 

MEA 

N 

Sample 

Size 

Question 

D1Q02 

5.57 

72 

Where  received  hostile  fire  before  entering 
building? 

DlQOl 

5.39 

54 

Where/what  do  you  expect  OpFor  to  do? 

D1Q07 

5.22 

72 

Where  were  obstacles  foimd  in  C4? 

D2Q02 

5.20 

71 

Likely  location  of  OpFor  reinforcements? 

D1Q04 

5.04 

72 

What  building  was  reported  to  be  heavily 
fortified? 

D1Q06 

4.99 

72 

What  will  OpFor  most  likely  do? 

D2Q01 

4.97 

71 

How  long  to  take  OpFor  to  get 
reinforcements? 

VIGNETTE  E 

Vignette 

Question 

Mean 

Sample 

Size 

Question 

E1Q09 

5.28 

72 

Where  are  the  OpFor  on  your  objective? 

E2Q07 

5.20 

80 

Where  were  the  OpFor  located  on  your  squad 
objective? 

E1Q02 

5.08 

72 

Do  you  have  OpFor  counterattack  threats? 
From  where? 

E1Q05 

4.99 

72 

T)q)e  hostile  fire  expected  from  OpFor  SE  of 
McKenna? 
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VIGNETTE  F 


Vignette 

Mean 

Sample 

Question 

Question 

Size 

F2Q05 

5.70 

71 

Where  are  ttie  OpFor  on  squad  objective 
located? 

F2Q04 

5.59 

71 

Have  you  received  hostile  fire  from  outside 
C4? 

F2Q10 

5.46 

72 

Where  did  yoiur  squad  encounter  booby 
traps? 

F1Q05 

5.44 

71 

Where  are  the  OpFor  in  squad  objective 
located? 

F1Q09 

5.01 

71 

What  type  reinforcements  does  the  OpFor 
have? 

63 


BY  BATTLEFIELD  OPERATION  SYSTEM  CATEGORY 


Vignette/  Maneuver 
Script  #  # 

Qs  C 
A-1  1  1 

A-4  1  0 

B-1  1  1 

B-3  1  0 

C-2  1  0 

C-4  0  0 

D-1  3  0 

D-2  2  1 

E-1  2  1 

E-2  1  0 

F-1  2  2 

F-2  3  1 

Total  18  5 


Intelli- 

C2 

#  #C  #  # 

Qs  Qs  C 

1  0  5  2 

10  7  4 

10  4  2 

10  5  4 

0  0  7  4 

0  0  4  3 

10  4  2 

0  0  6  2 

2  0  5  2 

5  13  1 

2  0  4  2 

2  0  2  0 

16  1  56  28 


Q  =  Question;  C  =  Critical  question 


M&S 
#  # 
Qs  C 

4  1 
2  1 

5  1 

3  1 

1  0 
5  1 

3  2 

3  1 
2  1 
1  1 
1  0 

4  4 

34  14 


Combat 
Service 
Support 
#  #C 
Qs 

0  0 
0  0 
0  0 
1  0 
1  0 
1  0 
0  0 
0  0 
0  0 
0  0 
1  0 
0  0 
4  0 


Fire 

Support 
#  #C 

Qs 

0  0 

0  0 

0  0 

1  0 

0  0 

0  0 

0  0 

0  0 

0  0 

0  0 

0  0 

0  0 

1  0 


Air 

Defense 
#  #C 
Qs 

0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
0  0 
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SECTION  2 


TEST  MATRIX,  SAMPLE  QUESTIONNAIRE,  AND  SCRIPT 


Week  1,8-12  May  00 


Daylight  Night 


Trial 

Squad 

Radio 

Vig 

Script 

Trial 

Squad 

Radio 

Vig 

Script 

1 

1 

Y 

A 

1 

19 

1 

N 

D 

1 

2 

2 

Y 

B 

3 

20 

2 

N 

E 

2 

3 

3 

Y 

C 

2 

21 

3 

N 

F 

1 

4 

1 

Y 

B 

3 

22 

1 

N 

E 

2 

5 

2 

Y 

C 

2 

23 

2 

N 

F 

1 

6 

3 

Y 

A 

4 

24 

3 

N 

D 

2 

7 

1 

Y 

C 

2 

25 

1 

N 

F 

1 

8 

2 

Y 

A 

4 

26 

2 

N 

D 

2 

9 

3 

Y 

B 

1 

27 

3 

N 

E 

1 

10 

1 

N 

A 

4 

28 

1 

Y 

D 

2 

11 

2 

N 

B 

1 

29 

2 

Y 

E 

1 

12 

3 

N 

C 

4 

30 

3 

Y 

F 

2 

13 

1 

N 

B 

1 

31 

1 

Y 

E 

1 

14 

2 

N 

C 

4 

32 

2 

Y 

F 

2 

15 

3 

N 

A 

1 

33 

3 

Y 

D 

1 

16 

1 

N 

C 

4 

34 

1 

Y 

F 

2 

17 

2 

N 

A 

1 

35 

2 

Y 

D 

1 

18 

3 

N 

B 

3 

36 

3 

Y 

E 

2 
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WEEK  2, 15-19  MAY  00 


Daylight  Night 


Trial 

Squad 

Radio  Vig 

Script 

Trial 

Squad 

Radio 

Vig 

Script 

1 

1 

N 

B 

1 

19* 

1 

Y 

E 

1 

2 

2 

N 

C 

4 

20* 

2 

Y 

F 

2 

3 

3 

N 

A 

4 

21* 

3 

Y 

D 

2 

4 

1 

N 

C 

4 

22* 

1 

Y 

F 

2 

5 

2 

N 

A 

1 

Void* 

2 

Y 

D 

1 

6 

3 

N 

B 

1 

24* 

3 

Y 

E 

1 

7 

1 

N 

A 

1 

25* 

1 

Y 

D 

1 

8 

2 

N 

B 

3 

26* 

2 

Y 

E 

2 

9 

3 

N 

C 

4 

27* 

3 

Y 

F 

2 

10 

1 

Y 

B 

3 

28 

1 

Y 

E 

2 

11 

2 

Y 

C 

2 

29 

2 

Y 

F 

1 

12 

3 

Y 

A 

1 

30 

3 

N 

D 

1 

13 

1 

Y 

C 

2 

31 

1 

N 

F 

1 

14 

2 

Y 

A 

4 

32 

2 

N 

D 

2 

15 

3 

Y 

B 

3 

33 

3 

Y 

E 

2 

16 

1 

Y 

A 

4 

17 

2 

Y 

B 

1 

18 

3 

Y 

C 

2 

*Data  not  used 
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WEEK  3, 22-26  MAY  00 


Daylight  Night 


Trial 

Squad 

Radio 

Vig 

Script 

Trial 

Squad 

Radio 

Vig 

Script 

1 

1 

Y 

c 

2 

19 

1 

N 

F 

1 

2 

2 

N 

A 

1 

20 

2 

Y 

D 

1 

3 

3 

Y 

B 

1 

21 

3 

N 

E 

1 

4 

1 

Y 

A 

4 

22 

1 

N 

D 

2 

5 

2 

N 

B 

3 

23 

2 

Y 

E 

2 

6 

3 

Y 

C 

4 

24 

3 

N 

F 

2 

7 

1 

Y 

B 

1 

25 

1 

N 

E 

1 

8 

2 

N 

C 

2 

26 

2 

Y 

F 

1 

9 

3 

Y 

A 

1 

27 

3 

N 

D 

1 

10 

1 

N 

C 

4 

28 

1 

Y 

F 

2 

11 

2 

Y 

A 

4 

29 

2 

N 

D 

2 

12 

3 

N 

B 

3 

30 

3 

Y 

E 

2 

13 

1 

N 

A 

1 

31 

1 

Y 

D 

1 

14 

2 

Y 

B 

1 

32 

2 

N 

E 

1 

15 

3 

N 

C 

2 

33 

3 

Y 

F 

1 

16 

1 

N 

B 

3 

34 

1 

Y 

E 

2 

17 

2 

Y 

C 

4 

35 

2 

N 

F 

2 

18 

3 

N 

A 

4 

36 

3 

Y 

D 

2 
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SAMPLE  QUESTIONNAIRE  AND  SCRIPT  Vignette  El 


ID#: 

NAME: 

RANK: 

YRS  IN  ARMY: 

UNIT: 

DATE: 

Please  answer  the  following  questions  based  on  your  experience  with  the  system. 
Answer  all  questions  as  accurately  as  possible.  Circle  the  appropriate  letter. 

1.  When  do  you  anticipate  the  Platoon  size  OpFor  element  will  reach  McKenna 
Village? 

a.  Less  than  30  minutes 
b: ^  30 minutes toah hour 

c.  More  than  an  hour 

d.  No  moving  in  the  direction  of  McKenna 

e.  Don't  know 

2.  Do  you  have  any  OpFor  counter  attack  threats,  if  so,  from  where? 

a.  No  threat  at  this  time 

b.  S/E  wood  line 

c.  1  Km  from  the  East 

d. '  1  Km  from  the  S/E 

e.  Don't  know 

3.  Are  there  any  reports  of  OpFor  Platoon  sized  units  outside  of  McKenna 
Village?  If  so  where  are  they  located? 

a.  Yes,  approximately  5  Km  S/E  of  McKenna  Village 

b.  Yes,  approximately  1  Km  N/E  of  McKenna  Village 

c.  Yes,  approxiniateiy  1  Km  S/E  of  McKertna  Village 

d.  No,  none  reported 

e.  Don't  know 

4.  If  yes,  what  is  the  rate  of  movement? 

a.  1  Km/hr 

b.  2  Km/hr 

c.  3  Km/hr 

d.  Not  moving 

e.  Don't  know 

5.  What  type  of  hostile  fire  do  you  expect  to  receive  from  the  OpFor  located 
southeast  of  McKenna? 

a.  Small  arms 

b.  Mortar 

c.  Light  machinegun 

d.  Heavy  machinegun 

e.  Don’t  know 

6.  What  OpFor  activity  was  reported  by  A  CO? 

a.  Squad  dug  in,  vicinity  of  the  cemetery 

b.  Squad  moving  south  in  the  vicinity  of  the  Cemetery 

c?^'  Heavy  MG  teammovingi  south  in  the  vicinity  of  the  Cemetery 
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6.  What  OpFor  activity  was  reported  by  A  CO? 

a.  Squad  dug  in,  vicinity  of  the  cemetery 

b.  Squad  moving  south  in  the  vicinity  of  the  Cemetery 

c.  Heavy  MG  team  moving  south  in  the  wcmity  of  theGemet^ 

d.  Nothing  reported 

e.  Don't  know 

7.  What  is  the  disposition  of  the  2”**  Squad? 

a.  Receivmg  hostile  fire  from  S/E  wood  line 

b.  Rec^vmg  AW  fire  from  S/E  wcbd  line 

c.  Receiving  AW  fire  from  S/W  wood  line 

d.  In  position,  no  contact  reported 

e.  Don't  know 

8.  Where  is  the  Company  CCP  currently  located? 

a.  East  end  of  Cl 

b.  West  end  of  Cl 

c.  East  end  of  A1 

d.  West  end  pfAi 

e.  Don't  know 

9.  Where  are  the  OpFor  on  your  objective  (if  any)? 

a.  Rooms  1  and  2 

b.  Rooms  2  and  3 

c.  Rooms  3  and  4 

d.  None 

e.  Don't  know 

10.  What  is  the  disposition  of  the  A  Company? 

:Toe-hold  'in  A4 

b.  Secured  A4 

c.  Toe-hold  in  A3 

d.  In  reserve 

e.  Don't  know 

11.  Where  is  your  Platoon  Sergeant  located? 

a.  Cl 

b.  C2 

c.  C4 

d.  KIA 

e.  Don't  know 


QUESTIONNAIRE  MATRIX 
Script  1,  Vignette  E 


Per-  Com-  Mobility  Combat 

cep-  prehen-  Projec-  Maneu-  InteUi-  &  Surviv-  Service  Fire  Air 

tion  sion  tion  ver  C2  gence  ability  Support  Support  Defense 


Qi 

B 

V 

Q2 

D 

V 

Q3 

C 

V 

Q4 

A 

cn 

o 

V 

V 

Q5 

D  § 

V 

Q6 

C 

V 

Q7 

B 

V 

Q8 

D 

V 

Q9 

C 

QIO 

A 

V 

V 

Qll 

B 
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SCRIPT  E-1 


Squad 

Support 

Platoon  Leader/WC 

Time 

Leader 

Squad 

ATK  from 

East  andN/E 

PL  located  west  end  of 

HHour 

C4  r' 
floor 

landing  to 

rooms  of 
building  C2 

Cl 

RPT:  2nd  Squad 

2^^  floor 

RPT:  to  PL: 
Receiving 

AW  fire  from 
S/E  wood 
line 

receiving  AW  fire  from 
S/E  wood  line 

RPT:  3^  Squad  secured 
North  side  C4  first 
floor 

Continue 

Observes  and 

RPT:  A  CO  established 

HHour 

ATK  from 
C4  r' 

engages  TO 

a  toe-hold  building  A4 

1  Min 

floor  to 

2^^  floor 

RPT:  2  OpFor  shooters 
sighted  on  B1  roof 

A  Co  RPT:  Heavy  MG 
team  moving  South 
vicinity  Cemetery 

1-3 

ExFor 

Observes  and 

RPT:  PSG  co-located 

Min 

WIAby 

window 

engages  TO 
RPT:  to  PL: 

w/2”^  Squad 

sniper 

Receiving 

RPT:  2*^^  Squad 

Room  1  (if 

Heavy  MG 

receiving  Heavy  MG 

exposed) 

fire  from 
vicinity  S/E 
wood  line 

fire  from  vicinity  S/E 
wood  line 

Squad 

Support 

Platoon 

Leader 

Squad 

Leader/WC 

3-5 

Enter/ 

Observes  and 

Request  SITREP 

Min 

clear 
room  1 

engages  TO 

RPT:  to  PL: 

RPT:  Company 
CCP/POW  relocated 

NOTE: 

Request 

to  West  end  of  building 

Find  1 
executed 
COB 
w /hands 
bound  in 
room  1 

Class  V  re- 
supply 

A1 

OpFor/COB 

2  OpFor  roof  B1  (firing  on 
C2)  (Time^ 

1  OpFor  room  3 

Fight  to  the  death  (Action') 

1  OpFor  room  4 
sxirrenders  at  first  sign  of 
ExFor  (Action') 

2  OpFor  S/E  wood  line 
(firing  on  C4/C2)  (Time') 

2  COBs  1  in  room  1  OK,  1 
in  room  2  dead  boimd  & 
blindfolded 

C^For  fire  firom  roof  of 
BLDG  B1  (Timel 


OpFor/COB 

2  dead  COBs  1  found  in 
room  1 

1  in  room  2  (bound  and 
blindfolded) 
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5-10 

Enter/cle 

Observes  and 

RPT:  OpFor  Platoon 

OpFor  Continues  to 

Min 

ar  room  2 

engages  TO 

last  reported  IK  S/E  of 

defend  in  rooms  3  and  4 

Kings  Pond  moving 

(Action) 

NOTE: 

Findl 

N/NWat  IK/HR 

2  OpFor  SE  wood  line 

executed 

RPT:  North-end  C4 

fire/  maneuver  to 

COB 

floor  secure  by  3rd 

building  C6  (Time) 

w/hands 
bound  in 
room  2 

Squad 

10-15 

Enter/ 

Observes  and 

Request  SITREP 

1  OpFor  KIA  room  3 

Min 

dear 

engages  TO 

(Action) 

rooms 

RPT:  OpFor  Platoon 

RPT:toPL:2 

vicinity  Hourglass  Rd 

1  OpFor  POW  room  4 

Enter/ 

OpFor 

moving 

(Action) 

dear 

engaged 

North/Northwest 

(Mavbe) 

room  4 

(possible  KIA 
depends  on 

RPT:  to  PL:  2  OpFor 

EC 

KIA  outside  building 

judgment) 
outside 
building  C6 

C6  Request  ACE 
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SECTION  3 


RESULTS  FROM  DEMOGRAPHIC  QUESTIONNAIRE 
SAMPLE  SIZE  =  84 

RANK  DUTY  POSITION  FOR  THIS  EXPERIMENT 


E-1-1 

E-4-19 

Squad  Leader  -  8 

Grenadier  - 18 

E-2-22 

E-5  - 14 

Team  Leader  -  20 

SAW  Gunner  -19 

E-3-25 

E-6  -  3  Rifleman  -  19 

AGE  Mean  =  22  years  (Range  17  to  31) 

1.  Handedness:  79  Right  J_Left 

2.  Height:  Mean  =  70  inches  (Range  64  to  77) 

Weight:  Mean  =  173  pounds  (Range  140  to  235) 

3.  Vision: 

a.  Is  your  vision  in  each  eye  20/20  or  correctable  to  20/20?  79  Yes  4  No  1  NR 

b.  Do  you  wear  glasses  when  performing  military  duties?  13  Yes  70  No  _1_  NR 

c.  Do  you  wear  contact  lenses  when  performing  military  duties?  _9_  Yes  74  No 

iNR 

4.  Education:  Mean  =  12.7  years 

5.  Current  MOS  Months  (Mean!  in  Current  MOS 

llB-84  21  months 

6.  Months  (Mean)  in  current  job:  11  months 

7.  Months  (Mean)  of  experience  in  Infantry-related  MOS:  22  months 

8.  Months  (Mean)  of  military  service:  24  months 

9.  Months  (Mean)  in  these  leadership  positions: 

a.  Fire  Team  Leader:  4  months 

b.  Squad  Leader:  1  month 

10.  Months  (Mean)  of  military  training/instruction  received  in  light  infantry 
operations: 

a.  Classroom  training  at  Infantry  School:  3  months 

b.  Field  exercises  (i.e.,  NTC,  JOTC,  CRTC,  MOUT  training):  5  months 
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11.  Months  (Mean)  of  military  training/instruction  received  in  the  following 
areas: 

a.  Land  navigation  (map  reading,  use  of  GPS  data,  following  planned  route): 

6  months 

b.  Route  planning:  5  months 

c.  Communications:  5  months 

12.  GT  Score:  Mean  =  118 

13.  Latest  Physical  Fitness  (PFT)  Score:  Mean  =  289  (out  of  300) 

14.  Latest  Firing  Qualification  Test  (FQT)  Score:  Mean  =  37  (out  of  40) 

Type  of  weapon:  M4  -  64  M240  -  1 

SAW  -  3  M203  -  1 

M16  - 10  NR  -  5 

15.  Self  rating  of  Knowledge,  Skills,  and  Abilities  (KSA)  related  to  Infantry  duties: 

1  2  3  4  5 

Poor  Below  Average  Above  Outstanding 

Average  Average 

MEAN  RESPONSE 

Knowledge  of  Infantry  tactics,  techniques,  and  procedures  (TTP). 

Knowledge  of  computers. 

Knowledge  of  electronics. 

Knowledge  of  mechanics  and  maintenance  procedures  for  weapon 
systems  and  equipment  used. 

Knowledge  of  map  reading  and  orientation  in  field  setting. 

Knowledge  of  land  navigation. 

Knowledge  of  reconnaissance,  surveillance,  and  target  acquisition 
procedures. 

Knowledge  relating  to  communications  equipment  and 
communications  procedures. 

Marksmanship  skills. 

Map  reading  skills. 

Land  navigation  skills. 

Computer  skills  (keyboards,  mouse,  track  balls,  navigating  in  and  out  of 
menus,  etc.). 

Commimication  skills  (ability  to  use  communications  equipment  and 
face-to-face  communications  to  enhance  mission  accomplishment). 

Leadership  skills 

16.  Months  (Mean)  of  military  deployment  for  peacekeeping,  peace  enforcement, 
stability  operations  of  combat: 

a.  2  months. 

b.  If  so,  where?  Sinai/Egypt- 1. 


3.60 

2.71 
2.73 

3.53 

3.78 

3.75 

2.96 

2.96 

4.07 

3.90 

3.72 

3.14 

3.31 

3.66 
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SECTION  4 


RESULTS  FROM  ASSESSMENT  OF  KNOWLEDGE  QUESTIONNAIRE 
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WE^  1  (contoia):  J." ; 
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WEEK!  (continued) 
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ASSESSMENT  OF  KNOWLEDGE  QUESTIONNAIRE  COMMENTS 
WITHAVITHOUT  RADIO  -  DAY 


A-1  Radio  Yes  .  - 

Squad: 

Information  came  when  we  were  still  taking  down  the  building.  I 
didn't  have  time  to  relay  all  the  info  when  I  received  it.  Building 
was  small  enough  that  enemy  SITREP  could  have  been  relayed 
verbally.  ICOM  seemed  to  get  in  the  way. 

Squad: 

Couldn't  hear  over  the  headphones. 

;  A-4RadioYes .  .  "  ;  . .  . 

1®‘ Squad: 

Couldn't  hear  anything. 

We  should  all  be  allowed  to  use  ICOMs. 

:;A<4  Radio  No 
1" Squad: 

It  was  better  to  use  hand  and  arm  signals  in  building.  Squad  was 
quiet  while  clearing  room. 

I  cannot  tell  if  my  men  get  the  information  when  they  don't  respond 
back. 

When  the  firefight  is  pushed  back  or  away  from  objective  building; 
then  the  squad  will  be  more  receptive  to  information  and  retain  it. 
Questions  should  be  directed  more  toward  locations  of  the  enemy 
positions  during  firefight. 

iB-1  Radio  Yes . 

1*‘  Squad 

We  should  all  be  allowed  to  use  the  ICOMs  like  we've  done  for  the 
past  year. 

2”“*  Squad: 

Look  into  the  Motorola  radios  in  the  civilian  market  ($70). 

B-1  Radio  No 
1®' Squad 

Information  was  a  lot  easier  to  pass  down  and  pass  up  in  defense. 
There  was  less  confusion  because  everybody  was  stationary  and  in  a 
small  area. 

ICOMs  would  be  helpful  in  cutting  down  movement  by  the  squad 
leader. 

Voice  worked  just  as  well,  I  thought,  due  to  small  area  for  my  squad. 
We  need  to  be  yelling  aU  the  time  when  in  the  absence  of  the  squad 
communication. 

This  TTP,  Squad  Leader  only  talk,  does  not  work. 

You  must  have  a  happy  medium  in  order  to  ensure  that  you  have 
confirmation  that  the  information  has  been  received. 


'  Nq.'' of 
Responses 

1 

1 

1 


1 

1 

1 


1 

1 

1 

1 

1 

1 

1 

1 
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|:S4:|ladib^: 


!*•  Squad 

ICOM  headset  was  hard  to  work  with  facemask  and  with  other 
radios. 

Information  could  be  put  out  verbally  just  as  well  in  this  situation 
(defense). 

Information  being  passed  down  will  be  dependent  on  the  situation 
for  it  to  get  passed  down,  hiformation  will  have  to  be  repeated  once 
or  twice,  depending  on  enemy  situation. 

Using  ICOM  alone  is  not  efficient  in  relaying  information.  Squad 
leaders  being  the  only  ones  who  can  transmit  does  not  allow  for 
verification  transmissions  were  received  or  imderstood.  There  must 
be  a  balance  of  verbal  and  radio  communication  in  order  to  ensure 
that  everyone  in  the  squad  fully  xmderstands  the  situation  at  hand, 
and  since  different  people  perceive  things  differently.  It  is  necessary 
sometimes  to  get  feedback  in  order  to  plan  a  picture  of  the 
battlefield. 


,  C-2  Radio  Yes  ' .'“I,: 

1*‘  Squad 

Used  ICOM  more  on  this  vignette.  Didn't  use  headset;  it  was  a  little 
easier  to  use.  Not  all  the  information  passed  to  me  was  important 
due  to  time.  It  was,  however,  important  if  we  had  follow-on 
missions  to  complete. 

I  feel  that  everyone  should  be  able  to  speak  on  the  squad  radios. 
This  would  be  more  effective  and  i 
^O-^RidioNo  . 


1'‘ Squad 

Kind  of  a  hard  budding  to  clear.  Fields  of  fire  were  bad.  ICOMs 
would  have  been  too  slow.  Voice  and  hand/arm  signals  worked  for 
the  most  part  to  clear  the  building. 

ICOMs  would  have  been  a  lot  easier  to  push  down  information  to 
the  squad  after  building  was  clear.  I  could  tell  when  I  put  out 
information  not  everybody  was  listening.  We  should  all  be  allowed 
to  talk  on  ICOMs. 


WITHAYITHOUT  -  NIGHT 


D-lRadio  No'  ’ "  '  "r*"  . "IC  • 

1®'  Squad: 

ICOMs  could  improve  stealth  in  building.  On  those  floors  with 
multiple  rooms,  ICOMs  would  improve  flow  of  information. 

3'**  Squad: 

Radio  on  other  end  did  not  work;  no  transmissions  were  received 
after  the  one. 


:  D-2 Radio-Yes  ■ '  ■  '•  , '  •< 

1*‘ Squad 

ICOM  worked  really  well;  put  out  mformation  quickly;  controlled 
the  squad;  there  was  less  movement  for  me  in  building.  _ 

i-E'i  Radio;  Yes . ■;;; . 

1*‘ Squad 

ICOMs  were  great. 

I  think  it  would  have  gone  a  lot  better  if  the  team  leaders  and  I  could 
free  talk.  They  could  relay  their  SITREP  and  ACE  report  widiout  me 
moving  through  the  building.  Plus,  it  would  allow  team  leaders  to 
maintain  more  control  of  their  teams,  and  they  would  not  have  to 
keep  coming  to  my  position  to  push  up  info. 

Use  of  ICOMs,  once  the  room/building  was  secure,  assisted  team 
leaders  in  giving  SITREPs  to  the  squad  leader.  This  enabled  team 
leaders  to  remain  in  control  of  their  teams  without  having  to  move 
to  the  squad  leader's  location.  This  is  essential  for  mission  success. 

E-2;^<H<)No  ■  __  V  , 

r' Squad 

ICOM  would  have  made  it  easy  to  push  down  mformation. 

;E-i'RadiaNo . . . 


Responses 


1'*  Squad 

ICOM  could  be  used  to  push  down  information  faster.  I  would  not 
have  had  to  move  as  much. 

ICOMs  are  a  must  at  night.  _  _  __ 

F-2RadfdYeS;  '  ■ 

1*'  Squad 

Team  leaders  to  give  SITREPs  and  ACE  reports  should  use  ICOM. 
Team  leaders  need  to  be  able  to  talk  to  me  to  help  direct  movement 
in  buildings  and  develop  security  plan.  We  need  to  be  able  to  talk  to 
each  other.  Just  like  I  talk  to  the  platoon  leader,  team  leaders  need 
to  talk  to  me. 

My  squad  teUs  me  they  like  having  the  radios. 

Team  leaders  respond  much  faster. 

With  radios,  there  is  less  movement  in  building;  when  there  is  more 
movement,  there  is  more  confusion. 

With  the  whole  squad  having  radios,  I  do  not  have  to  repeat  info  as 
many  times  as  I  do  without. 
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SECTION  5 


RESULTS  FROM  SUBJECTIVE  QUESTIONNAIRE 

1.  What  Were  the  Three  Most  Important  Things  You  Needed  to  Know  at  the  End 
of  the  Exercise? 


A-1 


Sqd 

2“  Sqd 

3“  Sqd 

Total 

Ensuing  mission 

3 

3 

Location  and  status  of  ExFor 

4 

10 

12 

26 

Location  and  status  of  OpFor 

7 

6 

7 

20 

ACE  Report 

3 

3 

6 

CCP  Location 

2 

2 

Status  of  HIP 

1 

1 

Status  of  COBs 

1 

1 

Medevac 

1 

1 

Building  Secure 

A-4 

3 

3 

Ensuing  mission 

6 

1 

7 

Location  and  status  of  ExFor 

4 

5 

7 

16 

Location  and  status  of  OpFor 

3 

5 

4 

12 

ACE  Report 

7 

1 

2 

10 

Medevac 

1 

5 

6 

Building  Secure 

6 

6 

Status  of  nerve  agent 

1 

1 

1 

3 

Location  of  booby  traps 

1 

1 
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<uld  you  rate  your  personal  situational  awareness  during  this  exercise? 
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I.  What  was  your  main  source  ofinformation  on  this  exercise? 
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WEEK  2 

Intrasquad  Radio  AN/PRC-126  Hand/Arm  Signals  Voice  Commands  Visual  Signals 
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Radio 


RESULTS  FROM  OPFOR  QUESTIONNAIRE 
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2.  How  would  you  rate  the  Ranger's  execution  of  this  mission? 


1 

2 

3  4  5 

6 

7 

Extremely 

Very 

Bad  Neutral  Good 

Very 

Extremely 

Poor 

Poor 

Good 

Good 

MEAN  RESPONSE 

Week  One  (sample  size  varied  from  4  to  10) 

Vignette/Script 

A-1 

A-4 

B-1 

B-3  C-2  C-4  D-1  D-2 

E-1  E-2 

F-1  ' 

F-2 

-fSt 

f' 

X 

Squad 

Squad 

463 

5.25 

5.30 

5.00,.,  425*  4.83  5.67  :450 

:5.83-.s  5.75 

5.57 

.'5.50  .* 

475 

5.29^ 

4.70 

4m  '  463-  5.67  "-467  4.75 

5.67  6.25 

5.29 

550,'; 

3rd 

r6-!v;4.6 

Squad 

475 

4.37 

'■'4.80 

•  :>  " 

4.60  f:450;^  4.83  5.83, f  4.50 

5.67  'i.OO 

5.00 

!4.83'| 

I*. 

Week  Two  (sample  size  varied  from  4  to  11) 

A-1 

A-4 

B-1 

B-3  C-2  C-4  D-1  D-2 

E-1  E-2 

F-1 

F-2 

ist 

-  'f  >’■ 

4.10  /4BV  5.00  *  * 

k' 

Squad 

2nd 

457 

S5.17 

5.00 

*  S2S'' 

5.71 

'•  65;-; ' 

Jt 

Squad 

4.88 

i.43 

470' 

4.56  ?5.25j  5.17  * 

9f-  if- 

5.57_ 

Sf- 

3™ 

Squad 

4.14 

4.88 

4.60 

4m  488  3.17  5.83 

*  4.50' 

Jf- 

a- 

Week  Three  (sample  size  varied  from  3  to  10) 

A-1 

A-4 

B-1 

B-3  C-2  C4  D-1  D-2 

E-1  E-2 

F-1 

F-2 

isl 

^  '' 

Squad 

425 

'■sjbo 

5.00 

460  "4.75:  5.33  6.20?  4.33 

=  •' '  to  f. 

5.40  6^00^ 

5.57 

rtskfl 

l'4  •  i‘ 

2nd 

r- 

"I"  -I  'v. 

5.17 

Squad 

4.50 

4.86 

4.78 

4.70  5.13  -'6.17,  5.33  5.00 

6.00  '433: 

s'  '  "J'  V 

*'5.86 

^ard 

f 

Squad 

4m': 

5.63 

450' 

4.78  4.71  '5.67  5.00  ';5.o6 ' 

X'  • 

5.20  -5.751 

5.57. 

i^Wb%:k 

5.20 

NOTE;  Shaded  =  with  radio;  Unshaded  =  no  radio. 
*  Uncontrolled  variables  resulted  in  invalid  data. 
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SECTION  7 


RESULTS  FROM  END-OF-EXPERIMENT  QUESTIONNAIRE 

1.  Please  rate  the  contribution  of  the  intra-squad  radio  to  your  situational  awareness: 


1 

2 

3 

4  5 

6 

7 

Extremely 

Very 

Somewhat 

About  Somewhat 

Very 

Extremely 

worse  than 

much 

worse  than 

the  better  than 

much 

better 

no  radio 

worse 

no  radio 

same  no  radio 

better 

than  no 

fiianno 

as  no 

than  no 

radio 

radio 

radio 

radio 

MEAN  RESPONSE 

Weekl 

Week  2 

Weeks 

1*'  Squad 

5.89 

6.44 

6.89 

2"'*  Squad 

6.44 

6.00 

6.78 

3'^  Squad 

5.70 

5.56 

6.56 

MEAN  =  6.26 

Comments 

No.  of 

Responses 

WEEKl 

More  useful  when  team  leaders  relay  their  situation  and  ACE  1 

reports  (free  talk  squad  leader  and  team  leaders). 

There  must  be  traffic  going  up  to  the  squad  leader.  This  enables  2 

team  leaders  to  maintain  control  of  their  teams  when  passing  up 
situation  reports. 

Retention  of  information  received  over  the  ICOMs  is  relative  to  the  1 

individual's  rank. 

The  MOUT  environment  is  one  of  the  least  times  we  use  ICOMs.  3 

The  most  beneficial  time  is  during  patrolling.  2 

Easier  to  reach  out  and  find  location  of  squad  with  radio. 

If  there  had  been  longer  movement  in  this  study,  the  radios  would  1 

have  proven  to  be  100  percent  necessary. 

Intra-squad  radios  allow  us  to  practice  silent  MOUT,  which  is  our  1 

SOP. 

Though  I  would  not  use  all  the  information  put  out,  some  1 

information  is  better  than  no  information. 

When  they  work,  they  are  ok.  1 

I  could  hear  what  was  going  on  more  clearly  firom  the  squad  leader;  1 

ihat  way  I  knew  what  to  do  before  file  team  leader  had  to  tell  me. 

I  would  give  it  a  better  vote  if  it  was  more  comfortable  to  wear,  but  1 

with  all  the  wires  it  is  a  pain  in  the  butt. 
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Comments  No.  of 

Responses 

WEEK  2 

1 

Need  inner  earpieces  for  better  retention  of  information. 

Squad  radios  allow  information  to  be  freely  transmitted  and  to  1 

know  exactly  what  is  going  on  with  no  talking. 

2 

Having  a  radio  is  very  important  part  of  squad  commuiucations. 

It  is  much  easier  to  communicate  with,  plus  it  makes  it  safer  because  1 

you  do  not  have  to  move  as  much.  Radio  is  good  but  everybody  in 
the  squad  does  not  need  to  talk. 

Useful  for  information.  1 

With  the  radio  you  have  the  option  of  both  voice  and  radio.  1 

The  ICOM  is  no  good.  1 

With  everyone  repeating  the  information  (with  no  radio)  I  1 

imderstood  it  more. 

WEEKS 

The  ICOM  is  very  good.  In  many  missions  they  are  the  main  source  1 

of  communication. 

I  was  RTO  for  6  months;  they  are  the  best.  1 

I  am  not  in  a  line  squad,  but  I  can  see  it  helps.  1 

In  a  weapons  squad  the  ICOM  is  a  must.  1 

We  have  to  be  in  contact  with  the  squads.  1 

It  is  quieter.  1 

Easier  to  control.  1 

ICOM  radios  make  it  possible  for  more  effective  reporting  even  if  1 

the  tests  do  not  show  it,  it  really  makes  everyone  more  aware. 

ICOM  enables  the  squad  to  communicate  over  distances  greater  1 

than  the  voice  can  carry. 
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2.  How  would  you  improve  the  ICOM  radio? 
Comments 


No.  of 
Responses 


WEEKl 


Increase  range.  19 

Make  it  waterproof.  28 

Improve  the  headset  (durability,  fit,  function,  size).  37 

Make  it  more  durable.  7 

Make  it  more  lightweight.  1 

Make  it  more  reliable.  3 

Make  it  smaller.  15 

Add  a  push  to  talk  button.  2 

Make  it  more  combat  accessible.  1 

Better  transmission.  1 

Longer  battery  life.  7 

Use  fewer  batteries.  4 

Needs  selectable  chaimels.  1 

No  rechargeable  batteries.  1 

Fewer  wires.  4 

Quiet  squelch.  1 

More  expensive  tiian  what  our  platoon's  personally  bought.  For  the  1 


cost  of  one  ICOM  complete,  you  could  outfit  a  9-man  squad  with  the 
Motorola  Talk  About  250  with  a  $2.00  headset  from  Radio  Shack. 
The  Talk  About  only  costs  $79.00.  It  has  an  effective  range  of  1.5 
miles  while  behind  tfiick  concrete  walls  of  the  Ranger  barracks.  It  is 


nearly  waterproof  and  indestructible.  It  only  takes  three  "AA" 
batteries,  which  will  last  almost  a  week  of  use. 

I  would  not  use  the  ICOM.  The  Motorola  Talk  About  is  a  superior  1 

intrasquad  mode  of  communication.  It  is  proven. 

Break  it  and  buy  a  Motorola  Talk  About.  1 

WEEK  2 

Need  inner  earpiece.  4 

Remote  the  PTT  switch.  1 

Better  activation  switch.  2 

Needs  to  be  louder.  1 

Need  a  wireless  headset.  1 

Needs  more  sensitivity.  1 

Mount  headset  directly  into  the  K-pot.  1 

Find  a  different  way  to  talk  (different  PTT,  maybe  voice  activated)  1 
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Comments 


No.  of 
Responses 


WEEKS 

Works  fine. 

Needs  voice-activated  headsets. 

Needs  Handless  mike  and  earpiece. 
Needs  Neck  mike  with  earpiece. 

Install  a  key  switch  on  weapon. 

Design  so  lhat  it  can  be  tied  down  better. 


Earpiece  should  be  modified  to  the  ones  similar  to  the  EC  earpiece.  1 

Find  a  headset  that  attaches  to  the  ear  with  a  small  flexible  1 

mouth  transmitter. 

Foimd  a  better  headpiece  at  PX  for  $12.  1 

Use  the  radio  as  a  microphone.  1 

Team  leaders  need  to  be  able  to  talk  for  this  test.  1 
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3.  What  suggestions  do  you  have  for  improving  squad  communication? 

Comments  No.  of 

Responses 

WEEKl 

Team  leaders  should  talk.  3 

Head  mike  needs  to  be  improved.  3 

More  reliable.  1 

Waterproof.  1 

Better  battery  life.  2 

More  durable.  1 

Soldiers  must  have  commo  discipline  to  avoid  too  much  radio  1 

traffic. 

Squad  leaders  must  do  the  talking.  1 

A  smaller  radio  with  a  small  set  of  earphones  tirat  fit  snug.  Speak  3 

up. 

Everyone  should  have  a  radio  and  be  able  to  cross  talk  with  one  1 

another. 

Squad  leader  and  team  leader  ensuring  information  is  disseminated.  1 

Use  Motorola's  instead  of  ICOMs.  15 

Use  Kenwood  instead  of  ICOM.  1 

By  confirmation  after  every  transmission  to  the  squad  leader.  1 

Motorola  is  extremely  water  resistant  (ICOM  is  not).  Only  cost  $70-  1 

$80.  Range  is  much  greater  -  2  miles  in  most  conditions. 

Allow  squad  members  to  speak  especially  team  leaders.  1 

Test  them  in  our  environment  the  way  we  use  them.  I  did  not  think  1 

you  wanted  the  test  group  to  know  what  was  being  done. 

A  headset  that  actually  stays  in  your  ear.  Motorola  has  a  pretty  1 

good  set  up;  you  shoidd  check  it  out. 

Do  not  transmit  vital  information  while  teams  are  clearing  rooms  or  1 

engaged  in  a  firelight. 

There  is  a  must  or  squad  radios  but  ICOM  is  not  where  it  is.  1 

Do  not  relay  all  tire  BS  down  the  chain  of  command  that  is  why  we  1 

have  squad  leaders.  Let  the  men  focus  on  what  is  at  hand. 

Distribute  only  important  information  relative  to  squad  mission.  2 

Eliminate  unnecessary  transmissions.  1 

Different  equipment.  The  others  cost  less  and  are  more  effective.  1 

Multi-net  radios.  Everyone  have  the  ability  to  hear  all  1 

transmissions. 

Besides  a  well  working  radio,  good  team  work.  Only  the  squad  can  1 

improve  the  squad. 
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WEEK  2 

Headset  that  would  work  with  FM,  MX,  and  ICOM  -  with  maybe  a  switch  to  1 
charge  off. 

Loader  headset.  1 

Ear  plug  speakers.  1 

Push  to  talk  button.  1 

Something  smaller.  2 

Squad  leaders  and  team  leaders  have  radios;  less  confusion.  2 

Platoon  leader  and  platoon  sergeant  use  the  radio  to  communicate  with  1 

squad  leader  and  team  leader. 

More  training;  better  imderstanding  of  mission.  1 

Do  not  send  worthless  information  through  the  radio.  1 

When  the  ICOM  gets  moist  or  wet,  it  stops  working  all  together.  2 

ICOM  had  very  limited  range.  2 

ICOM  is  very  fragile.  1 

Get  better  radios.  1 

Keep  practicing  movements  in  MOUT.  1 

During  the  experiment  I  was  only  allowed  to  use  the  ICOM.  If  the  platoon  1 


could  put  out  to  everyone  over  the  same  net,  it  would  alleviate  the  squad 
leader/team  leader  having  to  relay  everything. 

WEEKS 

Nothing,  leave  it  alone. 

Keep  using  ICOM. 


Keep  it  simple.  1 

Pay  attention  to  surrotmdings.  1 

Keep  giving  us  more  batteries;  the  procedures  are  taking  up  all  the  batteries  1 

for  charging. 

The  chargers  can  only  charge  6  batteries  at  a  time.  1 

The  metal  coimectors  rust  on  the  batteries.  1 

The  advantage  is  the  multi-channels.  1 

They  enhance  our  ability,  but  do  not  let  the  squads  forget  about  the  basics  1 

(arm-hand  signals). 

Maybe  a  pager  device  that  can  save  transmissions  in  text  format.  1 

Voice  activated.  1 

I  believe  that  no  noise  is  the  best.  Work  on  knowing  your  squad  and  know  1 

your  own  signals. 

Somehow  silence  them.  1 

Need  ear  piece  that  does  not  block  normal  sound.  1 

Let  all  pax  hear  platoon  net  but  speak  only  on  squad  net.  1 

Use  them  only  when  you  need  them  so  that  what  comes  across  is  easier  to  1 

retain. 

Make  up  an  SOP  so  that  everyone  is  on  the  same  page.  1 

Squad  leaders  and  team  leaders  need  to  be  able  to  talk  too.  5 

Members  of  squad  could  speak  louder  and  slower  into  radio.  1 

If  you  do  another  test,  use  MILES  because  with  Simunitions  you  have  to  use  a  1 

mask,  which  fogs  up  and  you  do  not  get  the  full  effect  of  normal  room 
clearing.  Use  the  unit's  SOP  for  numbering  building  because  it  is  already 
known.  Have  the  unit's  platoon  leader  give  the  operations  order  and  give  a 
few  days  for  TLPS.  I  think  then  you  would  get  a  test  which  information 


actually  registers  in  people's  minds  because  they  already  know  the  plan. 
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Intentionally  left  blank 
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NO.  OF 

COPIES  ORGANIZATION 


NO.  OF 

COPIES  ORGANIZATION 


1  ADMINISTRATOR 

DEFENSE  TECHNICAL  INFO  CTR 
ATTN  DTICOCA 

8725  JOHN  J  KINGMAN  RD  STE  0944 
FTBELVOIR  VA  22060-6218 

1  DIRECTOR 

US  ARMY  RSCH  LABORATORY 
ATTN  AMSRL  Cl  AI R  REC  MGMT 
2800  POWDER  MILL  RD 
ADELPHIMD  20783-1197 

1  DIRECTOR 

US  ARMY  RSCH  LABORATORY 
ATTN  AMSRL  Cl  LL  TECH  LIB 
2800  POWDER  MILL  RD 
ADELPHIMD  20783-1197 

1  DIRECTOR 

US  ARMY  RSCH  LABORATORY 
ATTN  AMSRL  D  D  SMITH 
2800  POWDER  MILL  RD 
ADELPHIMD  20783-1197 

1  DIR  FOR  PERS  TECHNOLOGIES 
DPY  CHIEF  OF  STAFF  PERS 
300  ARMY  PENTAGON  2C733 
WASHINGTON  DC  20310-0300 

1  DIRECTOR 

ARMY  AUDIOLOGY  &  SPEECH  CTR 
WALTER  REED  ARMY  MED  CTR 
WASHINGTON  DC  20307-5001 

1  OUSD(A)/DDDR&E(R&A)/E&LS 
PENTAGON  ROOM3D129 
WASHINGTON  DC  20301-3080 

1  CODE1142PS 

OFC  OF  NAVAL  RSCH 
800  N  QUINCY  STREET 
ARLINGTON  VA  22217-5000 

1  WALTER  REED  INST  OF  RSCH 

ATTN  SGRDUWIC 

COL  REDMOND 
WASHINGTON  DC  20307-5100 

1  CDR  US  ARMY  RSCH  INST 

ATTN  PERI  ZT  DR  E  M  JOHNSON) 
5001  EISENHOWER  AVENUE 
ALEXANDRIA  VA  22333-5600 


1  DEF  LOGISTICS  STUDIES 

INFORMATION  EXCHANGE 
ATTN  DIRDLSIEATSZDL 
BLDG  12500 
2401  QUARTERS  ROAD 
FORT  LEE  VA  23801-1705 

1  HEADQUARTERS  USATRADOC 
ATTN  ATCD  SP 
FORT  MONROE  VA  23651 

1  CDR  USATRADOC 

COMMAND  SAFETY  OFC 
ATTNATOS  PESSAGNO/LYNE 
FORT  MONROE  VA  23651-5000 

1  DIRECTOR  TDAD  DOST 
ATTN  ATTG  C 
BLDG  161 

FORT  MONROE  VA  23651-5000 

1  HQ  USAMRDC 
ATTN  SGRDPLC 
FORT  DETRICK  MD  21701 

1  CDR 

USA  AEROMEDICAL  RSCH  LAB 

ATTN  LIBRARY 

FORT  RUCKER  AL  36362-5292 

1  US  ARMY  SAFETY  CTR 
ATTN  CSSC  SE 
FORT  RUCKER  AL  36362 

1  CHIEF 

ARMY  RSCH  INST 
AVIATION  R&D  ACTIVITY 
ATTN  PERIIR 

FORTRUCBCER  AL  36362-5354 

1  AIR  FORCE  FLIGHT  DYNAMICS  LAB 

ATTN  AFWAL/FIES/SURVIAC 
WRIGHT  PATTERSON  AFB  OH  45433 

1  US  ARMY  NATICK  RD&E  CTR 
ATTN  STRNCYBA 
NATICK  MA  01760-5020 

1  US  ARMY  TROOP  SUPPORT  CMD 

NATICK  RD&E  CTR 
ATTN  BEHAVIORAL  SCI  DIV  SSD 
NATICK  MA  01760-5020 
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NO.  OF 

COPIES  ORGANIZATION 

1  US  ARMY  TROOP  SUPPORT  CMD 
NATICK  RD&E  CTR 
ATTN  TECH  LIB  (STRNC  MIL) 
NATICK  MA  01760-5040 

1  DR  RICHARD  JOHNSON 

HEALTH  &  PERFORMANCE  DIV 
US  ARIEM 

NATICK  MA  01760-5007 

1  USAF  ARMSTRONG  LAB/CFTO 
ATTN  DR  F  W  BAUMGARDNER 
SUSTAINED  OPERATIONS  BR 
BROOKS  AFB  TX  78235-5000 

1  ARI  FIELD  UNIT  FT  KNOX 
BLDG  2423  PERI  IK 
FORT  KNOX  KY  40121-5620 

1  USA  TRADOC  ANALYSIS  CMD 
ATTN  ATRC  WSR  D  ANGUIANO 
WSMR  NM  88002-5502 

1  STRICOM 

12350  RSCH  PARKWAY 
ORLANDO  FL  32826-3276 

1  CDR 

USA  COLD  REGIONS  TEST  CTR 
ATTN  STECRTSA 
APO  AP  96508-7850 

1  GOVT  PUBLICATIONS  LIB 
409  WILSON  M 
UNIVERSITY  OF  MINNESOTA 
MINNEAPOLIS  MN  55455 

1  DR  RICHARD  PEW 

BBN  SYSTEMS  &TECH  CORP 
10  MOULTON  STREET 
CAMBRIDGE  MA  02138 

1  MR  R  BEGGS 

BOEING-HELICOPTER  CO 
P30-18 

PO  BOX  16858 
PHILADELPHIA  PA  19142 

1  DR  ROBERT  KENNEDY 

ESSEX  CORPORATION  STE227 
1040  WOODCOCK  ROAD 
ORLANDO  FL  32803 


NO.  OF 

COPIES  ORGANIZATION 

1  DR  NANCY  ANDERSON 
DEPT  OF  PSYCHOLOGY 
UNIVERSITY  OF  MARYLAND 
COLLEGE  PARK  MD  20742 

1  DR  BEN  B  MORGAN 
DEPT  OF  PSYCHOLOGY 
UNIV  OF  CENTRAL  FLORIDA 
PO  BOX  25000 
ORLANDO  FL  32816 

1  LAWRENCE  C  PERLMUTER  PHD 

UNIV  OF  HEALTH  SCIENCES 
THE  CHICAGO  MEDICAL  SCHOOL 
DEPT  OF  PSYCHOLOGY 
3333  GREEN  BAY  ROAD 
NORTH  CHICAGO  IL  60064 

1  GMC  N  AMER  OPERATIONS 
PORTFOLIO  ENGINEERING  CTR 
HUMAN  FACTORS  ENGINEERING 
ATTN  MR  A  J  ARNOLD 
STAFF  PROJENG 
ENGINEERING  BLDG 
30200  MOUND  RD  BOX  9010 
WARREN  MI  48090-9010 

1  GENERAL  DYNAMICS 

LAND  SYSTEMS  DIV  LIBRARY 
PO  BOX  1901 
WARREN  MI  48090 

1  DRLLOYD  AAVANT 
DEPT  OF  PSYCHOLOGY 
IOWA  STATE  UNIVERSITY 
AMES  lA  50010 

1  DRMMAYOUB  DIRECTOR 
INST  FOR  ERGONOMICS  RSCH 
TEXAS  TECH  UNIVERSITY 
LUBBOCK  TX  79409 

1  MRWALTTRUSZKOWSKI 
NASA/GODDARD  SPACE 
FLIGHT  CTR 
CODE  588.0 

GREENBELT  MD  20771 

1  DR  NORMAN  BADLER 

DEPT  OF  COMPUTER  &  INFO 
SCIENCE 

UNIV  OF  PENNSYLVANIA 
PHILADELPHIA  PA  19104-6389 
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NO.  OF 
COPIES 

1 

1 

1 


1 

1 

1 

1 

1 

1 


NO.  OF 

COPIES  ORGANIZATION 


:  ORGANIZATION 
CDR 

US  ARMY  RSCH  INST  OF 
ENVIRONMNTL  MEDICINE 
NATICK  MA  01760-5007 

HQDA  (DAPE  ZXO) 

ATTN  DRFISCHL 
WASHINGTON  DC  20310-0300 

HUMAN  FACTORS  ENG  PROGRAM 
DEPT  OF  BIOMEDICAL  ENGNG 
COLLEGE  OF  ENGINEERING  & 
COMPUTER  SCIENCE 
WRIGHT  STATE  UNIVERSITY 
DAYTON  OH  45435 

CDR 

USA  MEDICAL  R&D  COMMAND 
ATTN  SGRD  PLC  LTC  K  FRIEDL 
FORT  DETRICK  MD  21701-5012 

PEO  ARMORED  SYS  MODERNIZATION 
US  ARMY  TANK-AUTOMOTIVE  CMD 
ATTN  SFAEASMS 
WARREN  MI  48397-5000 

PEO  COMMUNICATIONS 
ATTN  SFAECMRE 
FT  MONMOUTH  NJ  07703-5000 

JON  TATRO 

HUMAN  FACTORS  SYS  DESIGN 
BELL  HELICOPTER  TEXTRON  INC 
PO  BOX  482  MAIL  STOP  6 
FT  WORTH  TX  76101 

CHIEF  CREW  SYS  INTEGRATION 
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